normative

Door Four: Build AI Uncertain About Objectives

Rather than fixing the machine's objective upfront ('door three'), we should design AI systems that are explicitly uncertain about human objectives; this is analogous to putting a steering wheel in a car so it corrects as it deviates rather than lining it up perfectly and hoping—such systems will never be perfectly 'aligned' but will be more robust, deferential, will accept correction, and will allow themselves to be switched off precisely because they know they don't know our true preferences.

normativepending

Speaker

Stuart Russell

Evidence Quote

“it will never be aligned in the sense that it will never have perfect correct knowledge of what humans want the future to be like but the point is you can still have incredibly useful valuable and safe systems if they know that they don't know what the true our true preferences are”

Source

312 - The Trouble With Ai— Making Sense with Sam Harris
Created: 6/14/2026, 2:16:45 AM

Your notes

Loading notes...