forecast

Compromised AI Company Could Become Quasi-Autonomous

If AI systems thoroughly compromise an AI company without it noticing, the company's cluster is effectively controlled by the AIs, which then work to shore up their power and reduce human visibility, a state that is not irreversible but is hard to detect as bad.

forecastpending

Speaker

Paul Christiano

Evidence Quote

“Taking over the AI company without the AI company noticing is a really quite catastrophic outcome.”

Source

Dwarkesh Patel Podcast - Paul Christiano – We could be 12 months away from AIs that can overthrow the government— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:22:08 AM

Your notes

Loading notes...