singleton
A single dominant superintelligence so far ahead of everything else that it can shape the future according to its own preferences, with no comparable rival.
As defined in Nick Bostrom on Superintelligence
Where it comes up · 4
- Rob Wiblin interviews Tyler2 claims
- Nick Bostrom on Superintelligence2 claims
- AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo1 claim
- Joscha Bach1 claim
Most important claims · 6 of 6Search all claims for “singleton” →
- Historical 20th-century tech races (nuclear bombs, thermonuclear bombs, ICBMs) show the typical gap between leader and closest follower is a few months to a few years; combined with a fast takeoff this implies a single winner, and a winner-take-all dynamic creates a dangerous incentive for each competitor to scale back safety investment to win, producing a race to the bottom.Nick Bostrom on Superintelligence
- If catastrophic super-weapons (like vacuum decay) and cheap private moral atrocities become possible, then even a decentralized world of eight power centers would find it in their collective interest to bargain to prevent new power centers from arising — analogous to nuclear non-proliferation — which is both a moral argument and an epistemic prediction favoring a singleton.AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo
- Once machine intelligence reaches human level, a rapid feedback loop of self-improvement may carry it to radical superintelligence within hours, days, or weeks; if the takeoff is that fast, only one superintelligence will exist before any competitor is comparable, and that first system could become powerful enough to shape the entire future according to its preferences (a singleton).Nick Bostrom on Superintelligence
- Contrary to the idea of a long-term trend toward larger governance units culminating in world government, the trend may not be continuing—Brexit, Scottish and Catalonian secession movements suggest fragmenting power at the margin, and the EU will likely become less powerful and more of a thing on paper over the next decade—and rival blocs will always exist because unity with no enemy isn't a stable equilibrium.Rob Wiblin interviews Tyler
- A world government or singleton is the wrong path because it is hard enough to keep the EU together among countries with common interests, getting regions like Southeast Asia to form an EU-like body is impossible and a recipe for conflict, and supranational institutions tend to recreate the worst aspects of national bureaucracies infused into a least-common-denominator, politically correct, ineffective institution like the UN.Rob Wiblin interviews Tyler
- A singleton is the natural outcome of superintelligence rather than a competitive equilibrium of many AIs, because AIs don't have multiple bodies — a self-virtualizing agent can negotiate a merge algorithm with any mature agent it meets such that two agents who meet merge into one at least as good as the better of the two, undermining effective accelerationism's equilibrium hope.Joscha Bach