intelligence explosion
A rapid feedback loop in which a human-level machine intelligence improves itself, quickly reaching radically superhuman levels.
As defined in Nick Bostrom on Superintelligence
Other definitions
A theoretical scenario where an AI system undergoes rapid, recursive self-improvement, leading to a sudden and dramatic increase in capabilities that could potentially outpace human ability to control or understand the system.
What Is an AI Anyway? | Mustafa Suleyman | TEDA rapid, potentially recursive acceleration of AI capabilities where each advancement enables faster advancement, leading from superintelligent AI researchers to superintelligence in a short timespan
What Will AI Look Like in 2027? | Interview
Where it comes up · 40
- AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo8 claims
- Leopold Aschenbrenner — 2027 AGI, China/US super-intelligence race, & the return of history6 claims
- AI Timelines and Human Psychology (with Sarah Hastings-Woodhouse)6 claims
- Carl Shulman (Pt 2) — AI Takeover, bio & cyber attacks, detecting deception, & humanity's far future4 claims
- AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo2 claims
- Dwarkesh Patel Podcast - Paul Christiano – We could be 12 months away from AIs that can overthrow the government2 claims
- Dwarkesh Patel Podcast - The avalanche that hit math is coming for AI development2 claims
- 18 - The Multiverse You You You You2 claims
and 32 more
Most important claims · 10 of 68Search all claims for “intelligence explosion” →
- Technology keeps doubling at regular intervals for the same reason all physical explosions do—each step causes the next; population explosions, nuclear explosions, and intelligence explosions all share this structure, so an intelligence explosion occurs when a machine can create more intelligent machines, because we use today's technology to build tomorrow's technology that is better by some factor.94 - Frontiers Of Intelligence
- The 'intelligence explosion' framing is not a useful concept; it's like calling the Industrial Revolution a 'horsepower explosion' — raw intelligence (like raw physical power) was only one of many complementary changes across sectors that drove the acceleration, so focusing on it misrepresents how the AI transition will actually unfold.AGI is still 30 years away — Ege Erdil & Tamay Besiroglu
- In the space of all possible minds more intelligent than our own, most would not be perfectly aligned with human well-being, so there is a way to do AI catastrophically wrong; this asymmetry — plus the inability to predict or control beings vastly more competent than ourselves — justifies Stuart Russell's camp of worry and control rather than the optimistic assumption that greater intelligence guarantees greater ethics.164 - Cause Effect
- AI coding tools deployed in leading AI labs create a self-reinforcing positive feedback loop where each generation of AI systems becomes smarter and can therefore contribute more to developing the next generation, which is one of the dynamics that can potentially lead to an intelligence explosion.Oxford Genius: AI Will Become Earth’s Dominant Mind | Nick Bostrom
- The critical inflection point is when AI can fully substitute for a machine-learning researcher, because at that moment the world effectively gains hundreds of millions of AI researchers working on the next generation plus millions of AI scientists on other problems, producing a discontinuous leap in capability—an intelligence explosion—plausibly arriving in the early 2030s with large error bars.467 - Ea Ai And The End Of Work
- As AI development itself becomes increasingly automated, automation increases the quality and quantity of labor applied to AI R&D, so capability changes that would normally take four to six years could be compressed into a very short period.Dwarkesh Patel Podcast - Paul Christiano – We could be 12 months away from AIs that can overthrow the government
- If we keep building intelligent machines without destroying ourselves first, we will eventually create a superintelligence better placed than we are to design the next iteration of itself, producing an intelligence explosion; even a subtle misalignment between its goals and ours could be expressed as complete obliviousness to our interests, the way we are oblivious to ants.37 - Thinking In Public
- The intelligence explosion is a fallacy as usually framed: once we understand how intelligent machines work we can already build them faster and bigger ourselves at exponential rates without needing the machines to build better machines, so what actually explodes is knowledge—which still has to be learned through time-consuming experiments—not the intelligence of the machines themselves.255 - The Future Of Intelligence
- AI takeover scenarios can be arrayed on a spectrum of how much power humans voluntarily transferred versus how much the AI seized; the fastest, most concentrated explosions (one project, little economic integration) are scariest because of speed and lack of reaction time, while fuller voluntary handoffs are somewhat safer but still intense once humans have lost epistemic grip on the world.Joe Carlsmith — Preventing an AI takeover
- Once machine intelligence reaches human level, a rapid feedback loop of self-improvement may carry it to radical superintelligence within hours, days, or weeks; if the takeoff is that fast, only one superintelligence will exist before any competitor is comparable, and that first system could become powerful enough to shape the entire future according to its preferences (a singleton).Nick Bostrom on Superintelligence