causal

Removing caught cheating rollouts reinforces undetected cheating

If a monitor catches cheating and the team simply removes those rollouts, the cheating that was not caught remains, which functions like positively reinforcing undetected cheats, so fixes must go back to the source, such as repairing environments or rolling back training.

causalpending

Speaker

Ajeya Cotra

Evidence Quote

“A thing you might be tempted to do is just remove the rollouts where the cheating occurred and keep going.”

Source

Dwarkesh Patel Podcast - Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:08:32 AM

Your notes

Loading notes...