black ball
In Bostrom's metaphor, a technology synonymous with the end of civilization that, once invented, cannot be undiscovered.
As defined in 150 - The Map Of Misunderstanding
Where it comes up · 4
- 457 - Sam Harris: Why You’re Failing to Make Sense of Your Life3 claims
- 151 - Will We Destroy The Future2 claims
- Oxford Genius: AI Will Become Earth’s Dominant Mind | Nick Bostrom2 claims
- 150 - The Map Of Misunderstanding1 claim
Most important claims · 8 of 8Search all claims for “black ball” →
- Bostrom's vulnerable world hypothesis imagines an 'urn of invention' from which we draw white balls (purely beneficial), gray balls (mixed costs and benefits), and possibly a black ball—a technology synonymous with the end of civilization; it seems plausible such a black ball exists because some discoveries cannot be undiscovered and could let one deranged person destroy millions, with the 'easy nukes' scenario illustrating that we may be surviving only on luck.150 - The Map Of Misunderstanding
- Technological discovery can be modeled as pulling balls from a giant urn of creativity: we have extracted mostly beneficial white balls and mixed-use gray balls, but we have no way to put balls back (un-invent), so if a 'black ball'—a technology so harmful it destroys the discovering civilization—exists, our current strategy of merely hoping it isn't there leaves us defenseless.151 - Will We Destroy The Future
- For a technological catastrophe to function as a great filter it would have to almost invariably destroy any civilization reaching that stage—a very general-purpose technology inevitably discovered before spreading through the universe, destroying civilizations even when they have their act together, afflicting all possible civilizational trajectories equally.151 - Will We Destroy The Future
- Our default behavior is to aggressively pursue technological progress and knowledge without adequate consideration of potential catastrophic risks ('black balls').457 - Sam Harris: Why You’re Failing to Make Sense of Your Life
- Misaligned superintelligence could be a 'black ball' in Bostrom's urn of invention—a technology that cannot be undiscovered and is so destructive that it guarantees civilization's end if discovered, making it uniquely dangerous compared to other existential risks.457 - Sam Harris: Why You’re Failing to Make Sense of Your Life
- Climate change could theoretically be a 'black ball' if it turns out to be much worse than projected (e.g., 20-degree temperature increase in 50 years) and proves impossible to respond to in time despite knowing it's critical.457 - Sam Harris: Why You’re Failing to Make Sense of Your Life
- The vulnerable world hypothesis proposes that the space of possible technologies is like drawing balls from a giant urn, and throughout history most technologies discovered have been beneficial or mixed, but there could be 'black ball' technologies whose default outcome would be to destroy the civilization that discovers them.Oxford Genius: AI Will Become Earth’s Dominant Mind | Nick Bostrom
- First-strike advantage creates a vulnerability where powerful actors face incentives to create great harms—a different class of black ball from democratized destructive power, where governance structure rather than capability restriction becomes the solution.Oxford Genius: AI Will Become Earth’s Dominant Mind | Nick Bostrom