causal
Removing caught cheating rollouts reinforces undetected cheating
If a monitor catches cheating and the team simply removes those rollouts, the cheating that was not caught remains, which functions like positively reinforcing undetected cheats, so fixes must go back to the source, such as repairing environments or rolling back training.
causalpending
Speaker
Ajeya CotraEvidence Quote
“A thing you might be tempted to do is just remove the rollouts where the cheating occurred and keep going.”
Source
Dwarkesh Patel Podcast - Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:08:32 AM
Your notes
Loading notes...