normative

AI safety is a complex-systems risk problem

AI safety is a genuine and important problem that arises long before true artificial intelligence, because we already have computers, networks, and deep-learning algorithms too complex for any human to fully grasp, doing things for reasons no human knows; the real challenge is quantifying and protecting against risks in complex systems we do not fully understand.

normativepending

Speaker

Sean Carroll

Evidence Quote

“there are obvious risks associated with that kind of thing, long before you get to the point where you would call it artificially intelligent... how do you quantify risks and how do you protect yourself against risks for complex systems which you don't fully understand, that's a very, very important question”

Source

AMA | May 2021— Sean Carroll's Mindscape
Created: 6/13/2026, 3:36:54 AM

Your notes

Loading notes...