causal
AI risk arguments are really about balance of power
The general arguments used to scare us about AI—value fragility under FOOM, small utility-function differences decorrelating hard, instrumental incentives to seek power—are not specific to AI; they apply to making any agent (including a human) arbitrarily powerful, so the real story is about maintaining checks, balances, and distribution of power, not about human-versus-AI value differences per se.
causalpending
Speaker
Joe CarlsmithEvidence Quote
“it's a very open question how much it applies to humans as well.”
Created: 6/13/2026, 3:37:01 AM
Your notes
Loading notes...