← Jargon

Jargonartificial intelligence· 8 claims· 2 episodes

token consumption

The percentage or amount of the available context window that is actually used when processing an input; LLMs are most effective at approximately 20% token consumption and degrade steeply above 60%.

As defined in A Quick Lesson Of AI Languages


Other definitions
  • A pricing and usage model in which customers pay according to the number of model tokens processed, which scales with usage rather than headcount.

    Building Investing Superintelligence

Where it comes up · 2