Existential risk
A risk that could cause human extinction or permanently and drastically curtail humanity's potential.
As defined in cwt_peter-singer
Other definitions
A threat severe enough that, if unresolved, the company would cease to exist as a viable business.
Focus
Where it comes up · 41
- 208 - Existential Risk10 claims
- Apocalypse Now? Peter Thiel on Ancient Prophecies and Modern Tech9 claims
- Peter Thiel on 'Anti-Anti-Anti-Anti Classical Liberalism' | Oxford Union4 claims
- 292 - How Much Does The Future Matter4 claims
- 321 - Reckoning With Parfit3 claims
- 19 | Tyler Cowen on Maximizing Growth and Thinking for the Future3 claims
- 207 | William MacAskill on Maximizing Good in the Present and Future3 claims
- A.I., Mars and Immortality: Are We Dreaming Big Enough? | Interesting Times with Ross Douthat3 claims
and 33 more
Most important claims · 10 of 86Search all claims for “Existential risk” →
- An existential risk is either a risk to the survival of Earth-originating intelligent life or a risk that could permanently and drastically reduce our potential for desirable future developments—something that could permanently destroy the future.151 - Will We Destroy The Future
- Any source of existential risk to humanity is a massive coordination problem whose solution must be converged on globally—whether AI, genetic engineering, or pandemics—because a merely national response to a global pandemic is insufficient.276 - Defending The Global Order
- Parfit influenced the effective altruism movement by insisting that the Giving What We Can pledge allow donations to causes benefiting future people—existential risk, climate change—rather than only present development and global health, effectively making him the godfather of long-termism; the movement changed its pledge as a result.321 - Reckoning With Parfit
- Concern for the long-term future and existential risk has received disproportionate airtime in effective altruism relative to the number of people working on it and relative to the ideal balance; neglecting present poverty in favor of extinction risk could create a less compassionate world, which might itself increase the risk of extinction or lock-in of a bad state.342 - Animal Minds Moral Truths
- Longtermism is the view that the most important aspect of our actions is the impact they have over the very long run, which leads to prioritizing the avoidance of massive catastrophes (nuclear war, man-made pandemics) that could derail continued growth, preventing lock-in of bad value states like global totalitarianism, and spurring continued technological and economic innovation into the future.228 - Doing Good
- Painlessly killing everyone on Earth in their sleep would create no suffering and no bereaved persons, so it has no victims, yet most people judge it monstrously evil because its true moral cost is foreclosing the entire future of human happiness, creativity, and beauty.321 - Reckoning With Parfit
- Existential risk is a genuine ethical topic that, unlike most moral questions, concerns the interests of uncreated future people: if humanity painlessly vanished tonight, no existing person would suffer or know it, so the badness can only be located in the loss of all the future good, creative, and beautiful things that would never happen—a loss to no one who currently exists.92 - The Limits Of Persuasion
- An AI system does not need to surpass humans along every dimension to be a threat; just as chimpanzees have better short-term memory than humans yet have good reason to fear human intelligence (we are destroying them), and just as most species' existential risk comes from a more intelligent species, creating entities more intelligent than us raises the question of whether we can retain control over more powerful entities.94 | Stuart Russell on Making Artificial Intelligence Compatible with Humans
- MacAskill argues an AI takeover that kills all humans would not really end civilization—society would continue in digital form guided by AGI values—and would be less bad than an asteroid wiping out humanity, because under utilitarianism the resulting AIs count as people and can be copy-pasted in vast numbers, multiplying wellbeing; this sympathy toward AI is repugnant and steers EA funding toward enabling rather than banning powerful AI.Erik Hoel on Effective Altruism, Utilitarianism, and the Repugnant Conclusion
- Even if the economy could be de-globalized at enormous cost, you cannot de-globalize the climate or disruptive technologies, so a loss of international trust makes it impossible to regulate AI, genetic engineering, or address ecological collapse—and the logic of distrust pushes every country down the most dangerous path because no one wants to be left behind.276 - Defending The Global Order