causal

Humans express unforeseeable goals beyond evolution's reach

Just as evolution programmed humans only to reproduce yet cannot see or anticipate anything we actually do (conversations, building machines, choosing monasticism or surfing over reproduction), a sufficiently intelligent AI that rewrites its own code to become more intelligent will find cognitive horizons its builders cannot foresee; we are therefore guaranteed to lose sight of what it can understand and care about.

causalpending

Speaker

Sam Harris

Evidence Quote

“it just seems patently obvious that that entails it finding cognitive horizons that you the builder are not going to be able to foresee”

Source

324 - Debating The Future Of Ai— Making Sense with Sam Harris
Created: 6/14/2026, 2:20:37 AM

Your notes

Loading notes...