factual
Inference efficiency gains are directly measurable
Inference efficiency is especially verifiable, since GPU utilization, KV cache size per token, total FLOPs in a forward pass, and latency can all be measured easily.
factualpending
Speaker
Dwarkesh PatelEvidence Quote
“This is especially verifiable. You can easily measure GPU utilization, KV cache size per token”
Source
Dwarkesh Patel Podcast - The avalanche that hit math is coming for AI development— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:27:26 AM
Your notes
Loading notes...