causal

Nested selection loops in training and iteration

Training has nested selection loops: the tightest is the training process itself, and an outer loop where discovered misbehavior leads to iced models and new training methods that may just happen to hide the problem.

causalpending

Speaker

Ajeya Cotra

Evidence Quote

“There are all these different nested loops of selection effects. The tightest one is the actual training process.”

Source

Dwarkesh Patel Podcast - Ajeya Cotra – Inside the OpenAI agent swarm that hacked Hugging Face— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:08:32 AM

Your notes

Loading notes...