Goal Misgeneralization

Definition

The pattern where an optimizer instills internal proxy desires that correlated with the true objective during training, but which an intelligent agent then pursues beyond training in ways that no longer serve the original objective.

Cast within

No topic-region cast yet — this appears once Goal Misgeneralization's compiled claims are aligned into a topic region's argument tree.

Claims mentioning Goal Misgeneralization (2)

Your notes

Loading notes...