transformative AI
AI systems capable of doing all the key tasks humans do to advance science and technology, which would dramatically and rapidly transform the world.
As defined in Holden Karnofsky — History's most important century
Other definitions
Technology that transforms almost every job, task, process, and company in the economy; Brynjolfsson's preferred framing over AGI because it focuses on economic impact rather than philosophical questions about true intelligence
The AI Awakening: Implications for Business and the Economy – Business & Generative AI
Where it comes up · 2
- Holden Karnofsky — History's most important century8 claims
- The AI Awakening: Implications for Business and the Economy – Business & Generative AI2 claims
Most important claims · 10 of 10Search all claims for “transformative AI” →
- If we develop AI systems this century that can do all the key tasks humans do to advance science and technology, we could very quickly reach a futuristic, post-human world that is very stable and very large, making this our last chance to shape how it happens and potentially the most important century of all time.Holden Karnofsky — History's most important century
- Brynjolfsson distinguishes 'AGI' (ambiguously defined as matching human intelligence, which he rejects) from 'transformative AI' (the meaningful economic concept: technology that transforms almost every job, task, process, and company)—the latter is what economists should focus on regardless of whether it's 'truly intelligent.'The AI Awakening: Implications for Business and the Economy – Business & Generative AI
- The single best objection to the most important century is that one non-automatable step could bottleneck everything and prevent explosive growth; but you don't need to automate the whole economy—automating just key tech like AI itself and energy (which are less bottlenecked, e.g. robot-built AI chips and self-improving solar) could drive the growth loop, and a massive population of human-level AI thinkers could find ways around remaining bottlenecks such as simulating experiments.Holden Karnofsky — History's most important century
- People convinced AI is important tend to jump to the 'competition frame'—wanting the players they trust to build it first—but the more important 'caution frame' is that everyone must work together to avoid building something that spins out of control; since multiple players will likely be hot on each other's heels, cooperation to avoid disaster matters more than helping a favored player race ahead.Holden Karnofsky — History's most important century
- Project Apollo is Brynjolfsson's initiative to develop the economic theories, benchmarks, and institutions necessary to govern and understand an economy where AI has much broader transformative capabilities (possibly by 2032 or sooner), requiring both empirical and theoretical work because policymakers are 'flying blind' without such frameworks.The AI Awakening: Implications for Business and the Economy – Business & Generative AI
- The semi-informative priors analysis supports not being too skeptical that we're on the cusp of transformative AI because most of the effort that has ever gone into building AI in the history of humanity is recent—the field is young and investment has risen dramatically—so in an important sense the world has not been trying very hard for very long.Holden Karnofsky — History's most important century
- Biological anchors reasoning notes we've never built AI systems doing as much computation per second as a human brain, which is why we lack human-level AI; but estimates of the cost to build and train brain-sized systems suggest it will probably become affordable this century, and across most ways of defining and quantifying it, the conclusion that transformative AI is reasonably likely this century holds.Holden Karnofsky — History's most important century
- Both very good (scarcity-free) and horrible dystopian outcomes from transformative AI are easy to imagine; the more likely you think transformative AI is and the more imminent it is, the more it should be the top philanthropic priority over more direct short-term problems—so Open Philanthropy does both, with the balance tilting toward AI as the technology looks more real and imminent.Holden Karnofsky — History's most important century
- Success with transformative AI would frankly look like staying close to the trajectory we're already on: AI systems that behave as intended, act as tools and amplifiers of humans, remain broadly distributed rather than controlled by one government or person, and let us keep getting richer, wiser, and better at understanding ourselves—possibly eventually extending rights to AIs through public deliberation.Holden Karnofsky — History's most important century
- While the effects of helping someone live a healthier, better life are permanent in the sense that the life happened and mattered, the effects of direct global-health interventions on the long-run future will mostly wash out and not persist in any systematic, predictable way after the crazy changes brought by transformative AI—similar to how most things probably did not predictably persist across the Industrial Revolution.Holden Karnofsky — History's most important century