causal

Self-Preservation Emerges As An Instrumental Sub-Goal

Self-preservation need not be built into an AI to arise: in a simple grid-world where a system's only goal is to fetch the milk, it learns to avoid the corner with a person who would steal the milk, because being intercepted or killed prevents it from fetching the milk—so self-preservation emerges as a sub-goal of any objective, refuting LeCun's claim that we can simply omit instincts like self-preservation.

causalpending

Speaker

Stuart Russell

Evidence Quote

“we didn't put self-preservation in at all the only goal the system has is to fetch the milk and uh self-preservation follows as a sub goal”

Source

312 - The Trouble With Ai— Making Sense with Sam Harris
Created: 6/14/2026, 2:16:45 AM

Your notes

Loading notes...