factual

Facts do not motivate; a mind runs on is-questions

Hume's is-ought gap, recast as computer science, means there is a separable core of 'is' questions; a paperclip maximizer is built so that the is-questions 'how many paperclips result from this policy' and 'what policy yields the most paperclips' hook directly to its motor output, so it can know everything about what is good and still make paperclips because facts are not motivating.

factualpending

Speaker

Eliezer Yudkowsky

Evidence Quote

“you can know all there is to know about what is good and still make paper clips that's the way i would phrase that”

Source

116 - Ai Racing Toward The Brink— Making Sense with Sam Harris
Created: 6/14/2026, 2:07:58 AM

Your notes

Loading notes...