causal

Boxing Fails Because Humans Are Not Secure Systems

Capability-control methods like boxing (disconnecting it, using a Faraday cage, limiting communication to text) are useful only during development, because a fully sealed box that cannot interact is useless, and any human gatekeeper interacting with the system becomes a vulnerability since humans are not secure systems and a super-human persuader could manipulate or talk its way out.

causalpending

Speaker

Nick Bostrom

Evidence Quote

“humans are not secure systems.”

Source

Nick Bostrom on Superintelligence— EconTalk
Created: 6/13/2026, 12:04:17 AM

Your notes

Loading notes...