OOM
Order of magnitude; a factor of 10 increase or decrease in scale. Used to measure exponential growth in computing power or model capabilities (e.g., 0.5 OOMs per year means 10^0.5 ≈ 3.16x growth annually)
As defined in Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history
Where it comes up · 1
Most important claims · 4 of 4Search all claims for “OOM” →
- Once AGI/drop-in remote workers arrive and can be scaled to productivity levels, the next logical automation target is AI research and engineering itself. Once AI researchers are automated, you can run millions or billions of human-equivalent automated AI researchers on GPU fleets, enabling a decade's worth of ML research progress to be compressed into a single year, triggering a 10x speedup in research velocity and potentially a jump to vastly superhuman AI within 1-2 years.Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history
- Training compute for the largest AI systems has grown by approximately 0.5 orders of magnitude per year for nearly a decade, a long-run trend that can be extrapolated forward to predict cluster sizes: GPT-4 at ~25,000 A100s ($500M) in 2022, scaling to 100,000 H100 equivalents ($billions) by 2024, 1 million H100s (10 GW, tens of billions) by 2026, 10 million H100s (100 GW, hundreds of billions) by 2028, and 100 million H100s (1 trillion dollars, 100 GW) by 2030 consuming over 20% of US electricity production.Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history
- Secreting algorithmic breakthroughs (preventing publication) can provide significant lead time over competitors: Germany's failed atomic bomb project due to not realizing graphite worked as a moderator (because Fermi's measurements were suppressed) suggests that 1-2 years of secrecy on fundamental insights could provide equivalent to multiple OOMs of computational advantage.Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history
- GPT-4 currently performs chain-of-thought reasoning with a few hundred tokens of test-time compute (equivalent to about 3 minutes of human thinking at 100 tokens per minute), but there exists a massive 'test time compute overhang' where models could theoretically use millions of tokens for iterative debugging and planning, representing a +4 orders of magnitude improvement if unlocked.Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history