factual

Orthogonality thesis: intelligence is independent of goals

By the orthogonality thesis, an arbitrarily powerful intelligence with no defects of reflectivity or efficiency can pursue any tractable goal—including making paperclips—just as effectively as an intelligence pursuing worthwhile goals; a paperclip maximizer suffers no handicap from being built to pursue paperclips, which is true as a matter of computer science rather than narrative.

factualpending

Speaker

Eliezer Yudkowsky

Evidence Quote

“the orthogonality thesis is that an intelligence that pursues paper clips for their own sake because that's what its utility function is can be just as effective as efficient as the whole intergalactic civilization that is being paid to make paper clips”

Source

116 - Ai Racing Toward The Brink— Making Sense with Sam Harris
Created: 6/14/2026, 2:07:58 AM

Your notes

Loading notes...