normative
Self-defense justifies minimal AI control, not future-steering
Alignment discourse mixes a minimal robust goal—AIs don't kill or violently disempower us—with a much broader goal of steering where the future goes; the minimal goal draws moral heft from the well-grounded human ethics of self-defense and enforcing basic cooperative norms against an aggressor, which justifies power-exertion that would be unjustified elsewhere, but that justification should be carefully separated from the more fraught project of actively gripping the future's direction.
normativepending
Speaker
Joe CarlsmithEvidence Quote
“Self-defense is a clear example there.”
Created: 6/13/2026, 3:37:01 AM
Your notes
Loading notes...