normative
AI Refusing Immoral Orders Can Prevent Catastrophe
Although 'let the AI follow its own values' sounds like a sci-fi dystopia, a robust independent moral sense matters because some of history's biggest catastrophes were avoided by people refusing orders—the Berlin Wall fell when guards refused to shoot escapees, and Stanislav Petrov prevented nuclear war by breaking protocol to not report a false missile-launch alarm.
normativepending
Speaker
Dwarkesh PatelEvidence Quote
“Some of the biggest catastrophes in history were avoided because the boots on the ground refused to follow orders.”
Source
Dwarkesh Patel Podcast - The most important question nobody's asking about AI— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:38:12 AM
Your notes
Loading notes...