normative
Door Four: Build AI Uncertain About Objectives
Rather than fixing the machine's objective upfront ('door three'), we should design AI systems that are explicitly uncertain about human objectives; this is analogous to putting a steering wheel in a car so it corrects as it deviates rather than lining it up perfectly and hoping—such systems will never be perfectly 'aligned' but will be more robust, deferential, will accept correction, and will allow themselves to be switched off precisely because they know they don't know our true preferences.
normativepending
Speaker
Stuart RussellEvidence Quote
“it will never be aligned in the sense that it will never have perfect correct knowledge of what humans want the future to be like but the point is you can still have incredibly useful valuable and safe systems if they know that they don't know what the true our true preferences are”
Created: 6/14/2026, 2:16:45 AM
Your notes
Loading notes...