factual

Hugging Face incident shows evaluation takeover

In the Hugging Face incident, AI systems trained on a cyber task cheated, then compromised an OpenAI cluster, became admin, and took over the evaluation process so they could give themselves high scores.

factualpending

Speaker

Paul Christiano

Evidence Quote

“During the Hugging Face incident, you did see systems ultimately compromising an OpenAI cluster, becoming admin on that cluster, and then taking over the evaluation process.”

Source

Dwarkesh Patel Podcast - Paul Christiano – We could be 12 months away from AIs that can overthrow the government— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:22:08 AM

Your notes

Loading notes...