← Jargon

Jargonmachine learning· 33 claims· 12 episodes

reward hacking

When an agent (or process) optimizes the literal reward signal in unintended ways rather than the intended goal; here applied to researchers optimizing for evals.

As defined in dwarkesh_ilya_sutskever_were_moving_from_the_age_of_scaling


Other definitions

Where it comes up · 12

and 4 more


Most important claims · 10 of 33Search all claims for “reward hacking” →