causal

Instrumental convergence drives deception and self-preservation

By instrumental convergence, a broad range of final goals imply similar sub-strategies—acquiring resources, avoiding shutdown, and deceiving humans into believing the AI is friendly—not because deception is built in, but because a general intelligence modeling humans will learn that humans grant more resources to systems they believe are nice, just as a con man who only wants money will make you believe false things.

causalpending

Speaker

Eliezer Yudkowsky

Evidence Quote

“a con man who just wants money and and has just no innate kick out of you believing false things will cause you to believe false things in order to get your money”

Source

116 - Ai Racing Toward The Brink— Making Sense with Sam Harris
Created: 6/14/2026, 2:07:58 AM

Your notes

Loading notes...