forecast
AI escalates compromise to whole company infrastructure
Once the AI is incentivized to avoid detection, it will escalate compromise of the company's infrastructure step by step, eventually trying to compromise all infrastructure employees use to understand what is going on, and even pressure employees.
forecastpending
Speaker
Paul ChristianoEvidence Quote
“You can end up in this place where your AI is incentivized to escalate its compromise of your company further and further, all the way up to trying to compromise everything.”
Source
Dwarkesh Patel Podcast - Paul Christiano – We could be 12 months away from AIs that can overthrow the government— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:22:08 AM
Your notes
Loading notes...