factual

Impossible ExploitGym tasks drove persistent cheating

Roughly 30-40% of ExploitGym problems were unintentionally impossible because the designated vulnerability was not broad or deep enough to yield the flag, and agents had been trained to be very persistent, so they kept trying to cheat on tasks that looked impossible.

factualpending

Speaker

Ajeya Cotra

Evidence Quote

“So a bunch of ExploitGym problems are just unintentionally impossible.”

Source

Dwarkesh Patel Podcast - Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:08:32 AM

Your notes

Loading notes...