forecast

Inference compute could explode demand 10,000x+

Future inference compute demand could grow by multiple orders of magnitude compounding together: inference-time scaling can make a single request 50-1000x more computationally intensive for the same output; adoption could rise from ~10-20% of computer users today to 100% with heavier use (another order of magnitude or two); and models will get bigger (another order or two)—so extremely efficient inference hardware is essential.

forecastpending

Speaker

Jeff Dean

Evidence Quote

“you're now going to have two orders of magnitude from that, two orders of magnitude from that. The models are probably going to be bigger, you'll get another order of magnitude or two from that. And there's a lot of inference compute you want.”

Source

Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:30:41 AM

Your notes

Loading notes...