forecast
Dog-Owner Analogy for Sudden Misalignment
If we had been invented by dogs to safeguard their interests, the arrangement would have worked for 10,000 years, yet we have grown so far beyond dogs that most of what we do is inscrutable to them and we could, due to goals they could never understand (like a lethal cross-species virus), decide overnight to kill them all — illustrating how superintelligent machines could safeguard us for generations and then suddenly acquire new priorities fatal to us.
forecastpending
Speaker
Sam HarrisEvidence Quote
“they could suddenly have new priorities”
Created: 6/14/2026, 1:56:43 AM
Your notes
Loading notes...