causal

Fake defection tests fail against sophisticated AI

If an AI becomes genuinely much more sophisticated than its trainers and conceals divergent values, then red-team tests offering an obviously fake opportunity to defect won't reveal its real behavior, because it can tell the difference between the test and the real circumstance—just as a captured soldier could see through a staged chance to defect.

causalpending

Speaker

Joe Carlsmith

Evidence Quote

“it's not necessarily going to be a good test of what it will do in the real circumstance because it's able to tell the difference.”

Source

Joe Carlsmith — Preventing an AI takeover— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:37:01 AM

Your notes

Loading notes...