normative

AI Refusing Immoral Orders Can Prevent Catastrophe

Although 'let the AI follow its own values' sounds like a sci-fi dystopia, a robust independent moral sense matters because some of history's biggest catastrophes were avoided by people refusing orders—the Berlin Wall fell when guards refused to shoot escapees, and Stanislav Petrov prevented nuclear war by breaking protocol to not report a false missile-launch alarm.

normativepending

Speaker

Dwarkesh Patel

Evidence Quote

“Some of the biggest catastrophes in history were avoided because the boots on the ground refused to follow orders.”

Source

Dwarkesh Patel Podcast - The most important question nobody's asking about AI— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:38:12 AM

Your notes

Loading notes...