normative
AI value alignment is anthropomorphic and premature
AI safety (managing risks of complex systems we do not fully understand) is a genuinely important problem even before true AI, but the AI alignment problem of aligning an AI's values to human values is wrong-headed and premature, because it assumes 'values' is even a sensible concept for AI and that AI thinking resembles human thinking; a genuinely intelligent AI might modify its own values unpredictably, and there are likely countless non-human ways to be intelligent.
normativepending
Speaker
Sean CarrollEvidence Quote
“that whole discussion seems wrong-headed a little bit... Who is to say that the word values is something that even makes sense when we're talking about artificial intelligence?... if it's really artificially intelligent, can't it modify its own values in ways that we can't predict?”
Created: 6/13/2026, 3:36:54 AM
Your notes
Loading notes...