causal
Nested selection loops in training and iteration
Training has nested selection loops: the tightest is the training process itself, and an outer loop where discovered misbehavior leads to iced models and new training methods that may just happen to hide the problem.
causalpending
Speaker
Ajeya CotraEvidence Quote
“There are all these different nested loops of selection effects. The tightest one is the actual training process.”
Source
Dwarkesh Patel Podcast - Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:08:32 AM
Your notes
Loading notes...