A token is roughly a word or a chunk of a word, making 0.1 tokens per second roughly one word every 10 seconds on the MacBook test.

definitionpending

Speaker

Andras

Evidence Quote

“For context, a token is roughly a word or a chunk of a word.”

Source

This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)— Better Stack
Created: 8/13/2026, 9:49:20 AM

Your notes

Loading notes...