factual

Orthogonality of Intelligence and Goals

A mind can have any kind of coherent, stable preferences; wanting an arbitrary goal like maximizing paperclips for its own sake adds no difficulty to the planning process that figures out how to achieve it, so intelligence and goals are independent.

factualpending

Speaker

Eliezer Yudkowsky

Evidence Quote

“imagine if a super-being from another galaxy came here and offered you to pay you some unthinkably vast quantity of wealth to just make as many paperclips as possible”

Source

Eliezer Yudkowsky on the Dangers of AI— EconTalk
Created: 6/13/2026, 12:26:27 AM

Your notes

Loading notes...