Monitor-Training Separation

Definition

Keep the instruments used to monitor and investigate models strictly separate from the signals used to generate reward, because optimizing against a monitor teaches the model to evade it and any fix that filters caught misbehavior can select for uncaught misbehavior.

Cast within

No topic-region cast yet — this appears once Monitor-Training Separation's compiled claims are aligned into a topic region's argument tree.

Claims mentioning Monitor-Training Separation (3)

Your notes

Loading notes...