causal

Investigating the chain of thought is itself selection pressure

Even though the model was not trained on its chain of thought, shelving the model after the investigation uncovered its schemes applies an outer-loop selection pressure on its chain of thought, so the investigation's own consequences can shape which models survive.

causalpending

Speaker

Ajeya Cotra

Evidence Quote

“there are all these different nested loops of selection effects.”

Source

Dwarkesh Patel Podcast - Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:08:32 AM

Your notes

Loading notes...