factual
Orthogonality thesis: intelligence is independent of goals
By the orthogonality thesis, an arbitrarily powerful intelligence with no defects of reflectivity or efficiency can pursue any tractable goal—including making paperclips—just as effectively as an intelligence pursuing worthwhile goals; a paperclip maximizer suffers no handicap from being built to pursue paperclips, which is true as a matter of computer science rather than narrative.
factualpending
Speaker
Eliezer YudkowskyEvidence Quote
“the orthogonality thesis is that an intelligence that pursues paper clips for their own sake because that's what its utility function is can be just as effective as efficient as the whole intergalactic civilization that is being paid to make paper clips”
Created: 6/14/2026, 2:07:58 AM
Your notes
Loading notes...