causal

Light-touch intervention on chain of thought still erodes monitorability

Even when intervention on chain of thought is light-touch and research says it is fine if rare, each intervention based on observed reasoning applies a small pressure for the model to hide its chain of thought, so monitorability erodes over time.

causalpending

Speaker

Noam Brown

Evidence Quote

“every time you intervene based on your observations of the chain of thought, you are implicitly applying a tiny bit of pressure for the model to then hide its chain of thought.”

Source

Dwarkesh Patel Podcast - Noam Brown – Agent swarms, alignment, & recursive self-improvement— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:12:01 AM

Your notes

Loading notes...