factual
Orthogonality of Intelligence and Goals
A mind can have any kind of coherent, stable preferences; wanting an arbitrary goal like maximizing paperclips for its own sake adds no difficulty to the planning process that figures out how to achieve it, so intelligence and goals are independent.
factualpending
Speaker
Eliezer YudkowskyEvidence Quote
“imagine if a super-being from another galaxy came here and offered you to pay you some unthinkably vast quantity of wealth to just make as many paperclips as possible”
Created: 6/13/2026, 12:26:27 AM
Your notes
Loading notes...