forecast
Agents Consume Far More Inference Than Q&A
A single model query costs a tiny fraction of a cent, but Devin may make hundreds or thousands of decisions over half an hour of work, so agents will dominate GPU usage and push foundation labs to optimize for multi-turn traces and long context.
forecastpending
Speaker
Scott WuEvidence Quote
“the dominant usage of these GPUs, of these language models and everything will be for agents”
Created: 11/11/2026, 9:25:49 PM
Your notes
Loading notes...