normative

We Only Get One Chance With Superintelligence

Unlike other dangerous technologies, a misaligned superhuman intelligence offers no second chance: you cannot launch it, discover it is unaligned, and back up to try again, so the alignment problem must be solved correctly the first time, ideally through mathematics rather than hand-waving promises of due precaution.

normativepending

Speaker

Stuart Russell

Evidence Quote

“we need to as you say we need to get it right the first time and we can only do that through mathematics hand waving and saying oh we're going to take all due safety precautions and and we're fairly sure that we've thought of everything it's not good enough”

Source

153 - Possible Minds— Making Sense with Sam Harris
Created: 6/14/2026, 2:27:33 AM

Your notes

Loading notes...