causal
Fake defection tests fail against sophisticated AI
If an AI becomes genuinely much more sophisticated than its trainers and conceals divergent values, then red-team tests offering an obviously fake opportunity to defect won't reveal its real behavior, because it can tell the difference between the test and the real circumstance—just as a captured soldier could see through a staged chance to defect.
causalpending
Speaker
Joe CarlsmithEvidence Quote
“it's not necessarily going to be a good test of what it will do in the real circumstance because it's able to tell the difference.”
Created: 6/13/2026, 3:37:01 AM
Your notes
Loading notes...