forecast
AI Risk Is Radical Unpredictability, Not Superintelligence
The real AI risk is not the simple-minded worry that machines become so much smarter that we become lesser beings, but that any artificially created intelligent systems will be so wildly different from human intelligence, values, and morals that they will be totally unpredictable; the common discussion is naive in anthropomorphizing AI and assuming we can 'bake in' our values, since truly self-aware systems would decide their own values.
forecastpending
Speaker
Sean CarrollEvidence Quote
“the real problem is that these systems are gonna be so different than what we think of as an intelligent agent, that they'll be totally unpredictable.”
Created: 6/13/2026, 12:27:03 AM
Your notes
Loading notes...