causal

Moral reasoning is reflective equilibrium, not truth-injection

Based on how analytic ethicists actually reason—taking pre-theoretic intuitions and systematizing them into reflective equilibrium—Carlsmith doubts the 'everyone converges' prediction: an agent starting only with intuitions to maximize paperclips has no mechanism by which reflection injects mind-independent moral truth, so a real paperclipper put through reflection would not arrive at rich human morality; we'll get empirical evidence as AIs are trained.

causalpending

Speaker

Joe Carlsmith

Evidence Quote

“Most of what normative philosophy does is make consistent and systematize pre-theoretic intuitions.”

Source

Joe Carlsmith — Preventing an AI takeover— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:37:01 AM

Your notes

Loading notes...