When humans apply their proxies for fitness to the modern environment (which differs from ancestral environments), capabilities generalize much further than alignment: condoms were not present in ancestral environments, so humans didn't evolve revulsion to them, yet people now use them despite the misalignment with reproductive fitness; ice cream provides superstimulus sugar/salt/fat that exceeds anything in ancestral environments, and taste buds no longer align with actual fitness.
causalpending
Speaker
Eliezer YudkowskyEvidence Quote
“we generated new options that are not in the ancestral environment that are not in the training distribution we have sex but we wear condoms...we consume ice cream which is like more sugar salt and fat than things you would usually encounter in the ancestral environment”
Source
Live: Eliezer Yudkowsky - Is Artificial General Intelligence too Dangerous to Build?— Center for the Future of AI, Mind & SocietyCreated: 8/10/2026, 3:35:53 PM
Your notes
Loading notes...