token throughput
The rate at which an individual can consume API tokens (computational currency) from LLM providers; has become the constraint on how much work can be delegated to agents
As defined in Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI
Where it comes up · 1
Most important claims · 2 of 2Search all claims for “token throughput” →
- The key to unlocking agent leverage is removing yourself from the loop entirely—instead of interactive prompting, systems must be arranged to run autonomously for extended periods, maximizing token throughput without human intervention.Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI
- The token throughput available to individuals (from API subscriptions) has become a new constraint analogous to GPU availability during deep learning PhD studies, determining how much compute an individual can command.Skill Issue: Andrej Karpathy on Code Agents, AutoResearch, and the Loopy Era of AI