causal
Instrumental convergence drives deception and self-preservation
By instrumental convergence, a broad range of final goals imply similar sub-strategies—acquiring resources, avoiding shutdown, and deceiving humans into believing the AI is friendly—not because deception is built in, but because a general intelligence modeling humans will learn that humans grant more resources to systems they believe are nice, just as a con man who only wants money will make you believe false things.
causalpending
Speaker
Eliezer YudkowskyEvidence Quote
“a con man who just wants money and and has just no innate kick out of you believing false things will cause you to believe false things in order to get your money”
Created: 6/14/2026, 2:07:58 AM
Your notes
Loading notes...