causal
Light-touch intervention on chain of thought still erodes monitorability
Even when intervention on chain of thought is light-touch and research says it is fine if rare, each intervention based on observed reasoning applies a small pressure for the model to hide its chain of thought, so monitorability erodes over time.
causalpending
Speaker
Noam BrownEvidence Quote
“every time you intervene based on your observations of the chain of thought, you are implicitly applying a tiny bit of pressure for the model to then hide its chain of thought.”
Source
Dwarkesh Patel Podcast - Noam Brown – Agent swarms, alignment, & recursive self-improvement— Dwarkesh Patel PodcastCreated: 11/17/2026, 6:12:01 AM
Your notes
Loading notes...