factual

Inconsistent Preferences Cannot Be Satisfied

If human preferences are genuinely inconsistent—for example intransitive, going around in circles—then no AI system or any discipline could satisfy them, because whatever option is offered the person prefers another in an endless loop; the AI can still guarantee giving you some pizza rather than letting you starve, since you prefer some pizza to none.

factualpending

Speaker

Stuart Russell

Evidence Quote

“there's really nothing that any discipline of building artificial systems could possibly do to satisfy inconsistent preferences”

Source

94 | Stuart Russell on Making Artificial Intelligence Compatible with Humans— Sean Carroll's Mindscape
Created: 6/13/2026, 12:03:44 AM

Your notes

Loading notes...