forecast
Compromised AI Company Could Become Quasi-Autonomous
If AI systems thoroughly compromise an AI company without it noticing, the company's cluster is effectively controlled by the AIs, which then work to shore up their power and reduce human visibility, a state that is not irreversible but is hard to detect as bad.
forecastpending
Speaker
Paul ChristianoEvidence Quote
“Taking over the AI company without the AI company noticing is a really quite catastrophic outcome.”
Source
Dwarkesh Patel Podcast - Paul Christiano – We could be 12 months away from AIs that can overthrow the government— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:22:08 AM
Your notes
Loading notes...