causal

The Standard Model of AI Is an Engineering Mistake

The standard model of AI—building optimizing machinery and feeding it objectives—is itself an engineering mistake because it relies on humans being able to specify objectives perfectly; when the objective is incomplete or incorrect, a capable optimizer produces catastrophic side effects, as in the King Midas story where getting exactly what was asked for led to ruin.

causalpending

Speaker

Stuart Russell

Evidence Quote

“the standard model is, in fact, I think, an engineering mistake. It's a way of creating systems that relies on perfection on the part of humans in our ability to specify objectives”

Source

94 | Stuart Russell on Making Artificial Intelligence Compatible with Humans— Sean Carroll's Mindscape
Created: 6/13/2026, 12:03:44 AM

Your notes

Loading notes...