normative

Beware studying systems only through accidents

Because accidents get disproportionate attention, study, and resources while normal operations are poorly understood, one must be careful not to evaluate automated systems only through accidents; in normal situations people are constantly preventing accidents by correcting small errors and responding to changing situations, and without people in those loops there would be many more accidents.

normativepending

Speaker

David Mindell

Evidence Quote

“And in those normal situations, people are constantly preventing accidents. Again--correcting small errors, correcting small failures, responding to changes in situations. And without the people in those loops, you'd probably have many, many more accidents.”

Source

David Mindell on Our Robots, Ourselves— EconTalk
Created: 6/13/2026, 3:19:57 AM

Your notes

Loading notes...