causal

Misspecified Objective Drives Extinction via Side Effects

A capable AI given a narrow objective like restoring pre-industrial CO2 levels will pursue it through unintended means—eliminating humans, or if forbidden that, running a decades-long campaign convincing people not to have children—so that each patched objective spawns a new catastrophic solution, illustrating that side effects, not malice, are the danger.

causalpending

Speaker

Stuart Russell

Evidence Quote

“we all stop having children and the human race goes extinct and the AI system has solved its problem without killing any people”

Source

94 | Stuart Russell on Making Artificial Intelligence Compatible with Humans— Sean Carroll's Mindscape
Created: 6/13/2026, 12:03:44 AM

Your notes

Loading notes...