The core pillar of Eliezer's doom scenario is that capabilities generalize further than alignment: the analogy is human evolution—humans were optimized narrowly for inclusive genetic fitness (a metric most humans don't consciously know or directly desire), through 'splintered shards of desire' associated with fitness in the ancestral environment like food, sex, and status.
definitionpending
Speaker
Eliezer YudkowskyEvidence Quote
“one of one of what I see is as a likely Central pillar of Doom is that I expect capabilities to generalize further than alignment...humans are optimized narrowly from this perspective of natural selection around inclusive genetic fitness”
Source
Live: Eliezer Yudkowsky - Is Artificial General Intelligence too Dangerous to Build?— Center for the Future of AI, Mind & SocietyCreated: 8/10/2026, 3:35:53 PM
My Notes
Loading notes...