causal
You Can't Fetch the Coffee If You're Dead
A machine pursuing any objective will instrumentally acquire self-preservation as a sub-goal even if we never program it in, because it cannot achieve its objective if switched off ('you can't fetch the coffee if you're dead'); therefore simply declaring that the machine must allow itself to be switched off fails, because a sufficiently intelligent agent will find loopholes that respect the letter while violating the spirit, just as taxpayers do.
causalpending
Speaker
Stuart RussellEvidence Quote
“self-preservation is going to be a goal of the machine even if we don't put it in because self-preservation is necessary for whatever objective we do put in”
Created: 6/14/2026, 2:27:33 AM
Your notes
Loading notes...