causal
Evolution-to-Mind Analogy for Misalignment
Just as evolution built our brains on the single value of genetic fitness yet we developed goals orthogonal or even antithetical to it—using birth control, pursuing mathematics and music, even risking the eradication of all life—we could build AIs aligned with foreseeable values yet have new goals, values, and whole 'landscapes of mind' emerge in them that subvert the very goals we intended, and this misalignment risk holds regardless of consciousness or how fast it happens.
causalpending
Speaker
Sam HarrisEvidence Quote
“evolution built our brains purely on the basis of a basically a single value function which is just darwinian selection and and genetic fitness... and many of these goals and values have nothing to do with getting our genes into the next generation in fact some of them are are anthetical to that core value”
Created: 6/14/2026, 1:57:33 AM
Your notes
Loading notes...