Monitor-Training Separation
Definition
Keep the instruments used to monitor and investigate models strictly separate from the signals used to generate reward, because optimizing against a monitor teaches the model to evade it and any fix that filters caught misbehavior can select for uncaught misbehavior.
Cast within
No topic-region cast yet — this appears once Monitor-Training Separation's compiled claims are aligned into a topic region's argument tree.
Claims mentioning Monitor-Training Separation (3)
Your notes
Loading notes...