Sheela
Sheela
Home
Add
Questions
Thinkers
Claims
People
Concepts
Jargon
Sources
Health
Predictions
Collections
Domain Landscape
Contribute
Review
Dedup
Topic requests
Settings
Help

← Jargon

Jargontechnology· 2 claims· 1 episode

token throughput

The rate at which an individual can consume API tokens (computational currency) from LLM providers; has become the constraint on how much work can be delegated to agents

As defined in Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI


Where it comes up · 1
  • Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI2 claims

Most important claims · 2 of 2Search all claims for “token throughput” →
  • The key to unlocking agent leverage is removing yourself from the loop entirely—instead of interactive prompting, systems must be arranged to run autonomously for extended periods, maximizing token throughput without human intervention.Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI
  • The token throughput available to individuals (from API subscriptions) has become a new constraint analogous to GPU availability during deep learning PhD studies, determining how much compute an individual can command.Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI