normative

Weighing tiny catastrophic risks against tiny benefits

When facing a tiny probability of catastrophic harm from an experiment, the rational approach is not to focus on the catastrophe alone but to weigh it against the comparably tiny probability of enormous benefit; if the chance of great benefit is, say, a thousand times larger than the chance of disaster, that can tilt the decision toward proceeding, since refusing carries a hidden cost.

normativepending

Speaker

Martin Rees

Evidence Quote

“supposing that you thought that was a 1000 times less small than the chance of destroying anything, then that might tilt the balance.”

Source

86 | Martin Rees on Threats to Humanity, Prospects for Posthumanity, and Life in the Universe— Sean Carroll's Mindscape
Created: 6/13/2026, 12:06:41 AM

Your notes

Loading notes...