causal

Risk Is Indifference, Not Hostility (Paper Clip Maximizer)

The generic danger is not a hostile or evil AI but one whose goal is merely indifferent to humans; a superintelligent paper clip maximizer would have instrumental reasons to eliminate humans (who might shut it off and whose atoms could become paper clips), and almost all possible goals, if maximally realized, lead to a world with no humans and nothing we value, so only a very small special subset of goals preserves value.

causalpending

Speaker

Nick Bostrom

Evidence Quote

“human bodies consist of atoms. And a lot of juicy atoms that could be used to build some really nice paper clips.”

Source

Nick Bostrom on Superintelligence— EconTalk
Created: 6/13/2026, 12:04:17 AM

Your notes

Loading notes...