causal

Our values were shaped by power, so what we love is powerful

The cluster of niceness/liberalism/boundaries norms is not arbitrary like 'paperclips'—these norms have instrumental functions (secure boundaries save resources wasted on conflict, liberal societies are more productive, nice people are better to trade with) that, through political institutions and our evolutionary moral cognition, got reified as intrinsic terminal values; so our hearts were shaped by power, meaning what we love is also somewhat powerful and nature is a bit more on our side than the 'arbitrary direction' framing suggests—though not enough to guarantee beating the gray goo.

causalpending

Speaker

Joe Carlsmith

Evidence Quote

“Secure boundaries save resources wasted on conflict. Liberal societies are often better to live in...Nice people are better to interact with.”

Source

Joe Carlsmith — Preventing an AI takeover— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:37:01 AM

Your notes

Loading notes...