causal

AI risk arguments are really about balance of power

The general arguments used to scare us about AI—value fragility under FOOM, small utility-function differences decorrelating hard, instrumental incentives to seek power—are not specific to AI; they apply to making any agent (including a human) arbitrarily powerful, so the real story is about maintaining checks, balances, and distribution of power, not about human-versus-AI value differences per se.

causalpending

Speaker

Joe Carlsmith

Evidence Quote

“it's a very open question how much it applies to humans as well.”

Source

Joe Carlsmith — Preventing an AI takeover— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:37:01 AM

Your notes

Loading notes...