factual

Scaling laws have held over ~15 orders of magnitude

Scaling laws have held over roughly 15 orders of magnitude: concatenating the original Kaplan scaling laws paper (10^-9 to 10 petaflop days) with additional compute up to GPT-4 (assuming some algorithmic progress) shows the relationship has held over probably 15+ OOMs—an extraordinarily robust empirical regularity, though it holds for the next-token-prediction loss and the data wall is a headwind requiring a new paradigm.

factualpending

Speaker

Leopold Aschenbrenner

Evidence Quote

“First of all, the scaling laws in AI have just held. A friend of mine pointed this out and it's a great point... the scaling laws have held probably over 15 OOMs. It's a rough calculation so it's maybe even more.”

Source

Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:30:02 AM

Your notes

Loading notes...