factual

Neural nets needed a million times more compute

Neural nets were the right abstraction even in 1990—solving tiny toy problems no other approach could—but required roughly a million times more compute before they worked on real problems, which only became available in the 2008-2010 timeframe thanks to Moore's Law.

factualpending

Speaker

Jeff Dean

Evidence Quote

“it turned out we needed about a million times more compute before they really started to work for real problems”

Source

Jeff Dean & Noam Shazeer — 25 years at Google: from PageRank to AGI— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:30:41 AM

Your notes

Loading notes...