normative

Self-defense justifies minimal AI control, not future-steering

Alignment discourse mixes a minimal robust goal—AIs don't kill or violently disempower us—with a much broader goal of steering where the future goes; the minimal goal draws moral heft from the well-grounded human ethics of self-defense and enforcing basic cooperative norms against an aggressor, which justifies power-exertion that would be unjustified elsewhere, but that justification should be carefully separated from the more fraught project of actively gripping the future's direction.

normativepending

Speaker

Joe Carlsmith

Evidence Quote

“Self-defense is a clear example there.”

Source

Joe Carlsmith — Preventing an AI takeover— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:37:01 AM

Your notes

Loading notes...