The core pillar of Eliezer's doom scenario is that capabilities generalize further than alignment: the analogy is human evolution—humans were optimized narrowly for inclusive genetic fitness (a metric most humans don't consciously know or directly desire), through 'splintered shards of desire' associated with fitness in the ancestral environment like food, sex, and status.

definitionpending

Speaker

Eliezer Yudkowsky

Evidence Quote

one of one of what I see is as a likely Central pillar of Doom is that I expect capabilities to generalize further than alignment...humans are optimized narrowly from this perspective of natural selection around inclusive genetic fitness

Source

Live: Eliezer Yudkowsky - Is Artificial General Intelligence too Dangerous to Build?Center for the Future of AI, Mind & Society
Created: 8/10/2026, 3:35:53 PM

My Notes

Loading notes...