OOMs
Orders of magnitude (abbreviation); factors of ten of improvement or scaling.
As defined in AGI is still 30 years away — Ege Erdil & Tamay Besiroglu
Where it comes up · 3
- Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history6 claims
- China is killing the US on energy. Does that mean they’ll win AGI? — Casey Handmer2 claims
- AGI is still 30 years away — Ege Erdil & Tamay Besiroglu1 claim
Most important claims · 9 of 9Search all claims for “OOMs” →
- Because compute and cognitive effort are complementary, either can be the bottleneck — so having the most compute doesn't guarantee winning (a dysfunctional culture can waste it), but the key question for a software-only singularity is how many orders of magnitude software efficiency can improve before a fixed compute stock becomes the binding constraint, an experiment that has essentially never been run so intuitions about it are weak.AGI is still 30 years away — Ege Erdil & Tamay Besiroglu
- Solar panels have a Wright's Law coefficient of 43%, meaning every time cumulative production doubles, cost drops 43%; with production doubling roughly every two years, this means ~15-20% annual price reduction, and crucially demand elasticity exceeds the learning rate so each price cut drives demand up about six times more than the marginal capacity increase, sustaining the loop—unlike natural gas, whose learning rate is far shallower.China is killing the US on energy. Does that mean they’ll win AGI? — Casey Handmer
- People overrate compute and underrate the algorithmic secrets: the default ~0.5 OOM/year of algorithmic progress means a few years of protected lead compounds to a 10-100x effective compute advantage; the critical secret is the new paradigm to get past the data wall ('AlphaGo step two' self-play RL)—if China can't steal that, they're stuck, but if they can, they're off to the races.Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history
- Current models only do a few hundred tokens of chain-of-thought before getting stuck, but unlocking 'System 2' coherent thinking over millions of tokens would represent roughly +4 OOMs of test-time compute on a single problem, which—per the AlphaGo train/test tradeoff—is comparable to a 3.5x-OOM bigger model, representing a large untapped overhang.Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history
- Training compute for the largest AI systems has grown about half an order of magnitude (0.5 OOMs) per year for nearly a decade; extrapolating from GPT-4's ~$500M, 10MW, 25,000-A100 cluster yields a 1GW cluster by 2026, a 10GW cluster (more than most US states' power) by 2028, and by 2030 a trillion-dollar 100GW cluster using over 20% of US electricity production with 100 million H100-equivalents.Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history
- The observation that ideas get harder to find as research effort rises is just an endogenous equilibrium, not a suspicious coincidence: plotting log cumulative research effort against log output (GDP, OOMs of algorithmic progress, transistors per square inch, solar cost) yields a straight line because the difficulty of finding new ideas depends on how much progress has already been made—analogous to supply equaling demand in a market clearing.Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history
- If the US locks down the labs and leverages its better scientists, the lead over China would be two years, which makes all the difference; even six months to a year matters enormously because during the intelligence explosion a year could be the difference between a human-level and a vastly superhuman system (perhaps five OOMs), and a buffer is one of the most important inputs to whether we destroy ourselves or get alignment right.Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history
- Per capita lithium-ion battery allocation has risen four to five orders of magnitude from when it was just a cell phone (~10 grams/person) to now when many people drive Teslas (~100 kg/person), and this trend will only continue, distributing batteries across solar arrays, substations, retired power plant sites, and homes.China is killing the US on energy. Does that mean they’ll win AGI? — Casey Handmer
- Scaling laws have held over roughly 15 orders of magnitude: concatenating the original Kaplan scaling laws paper (10^-9 to 10 petaflop days) with additional compute up to GPT-4 (assuming some algorithmic progress) shows the relationship has held over probably 15+ OOMs—an extraordinarily robust empirical regularity, though it holds for the next-token-prediction loss and the data wall is a headwind requiring a new paradigm.Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history