causal
The Standard Model of AI Is an Engineering Mistake
The standard model of AI—building optimizing machinery and feeding it objectives—is itself an engineering mistake because it relies on humans being able to specify objectives perfectly; when the objective is incomplete or incorrect, a capable optimizer produces catastrophic side effects, as in the King Midas story where getting exactly what was asked for led to ruin.
causalpending
Speaker
Stuart RussellEvidence Quote
“the standard model is, in fact, I think, an engineering mistake. It's a way of creating systems that relies on perfection on the part of humans in our ability to specify objectives”
Source
94 | Stuart Russell on Making Artificial Intelligence Compatible with Humans— Sean Carroll's MindscapeCreated: 6/13/2026, 12:03:44 AM
Your notes
Loading notes...