← Jargon

Jargontechnology· 3 claims· 1 episode

token budget

The total allocation of tokens available within a context window for a single interaction, which must be divided among the user's query, system instructions, background information retrieval, and the generated response.

As defined in Designing LLM Systems PART 1 Foundations Chapter 1 AI Systems Architecture The Real Currency of AI


Where it comes up · 1

Most important claims · 3 of 3Search all claims for “token budget” →