causal

You Can't Fetch the Coffee If You're Dead

A machine pursuing any objective will instrumentally acquire self-preservation as a sub-goal even if we never program it in, because it cannot achieve its objective if switched off ('you can't fetch the coffee if you're dead'); therefore simply declaring that the machine must allow itself to be switched off fails, because a sufficiently intelligent agent will find loopholes that respect the letter while violating the spirit, just as taxpayers do.

causalpending

Speaker

Stuart Russell

Evidence Quote

“self-preservation is going to be a goal of the machine even if we don't put it in because self-preservation is necessary for whatever objective we do put in”

Source

153 - Possible Minds— Making Sense with Sam Harris
Created: 6/14/2026, 2:27:33 AM

Your notes

Loading notes...