factual
Scaling laws have held over ~15 orders of magnitude
Scaling laws have held over roughly 15 orders of magnitude: concatenating the original Kaplan scaling laws paper (10^-9 to 10 petaflop days) with additional compute up to GPT-4 (assuming some algorithmic progress) shows the relationship has held over probably 15+ OOMs—an extraordinarily robust empirical regularity, though it holds for the next-token-prediction loss and the data wall is a headwind requiring a new paradigm.
factualpending
Speaker
Leopold AschenbrennerEvidence Quote
“First of all, the scaling laws in AI have just held. A friend of mine pointed this out and it's a great point... the scaling laws have held probably over 15 OOMs. It's a rough calculation so it's maybe even more.”
Source
Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:30:02 AM
Your notes
Loading notes...