causal
Objective Functions Invite Specification Gaming
Maximizing a specified objective function leads systems to find loopholes that maximize the score while doing something unintended, a pattern that is extensive in AI history and drives the worry about all-powerful maximizers.
causalpending
Speaker
BrianEvidence Quote
“that field of AI has a long and colorful history of totally demented ways of finding some loophole that maximizes the score, while nonetheless, doing nothing like the behavior that you originally intended.”
Created: 11/19/2026, 9:46:21 AM
Your notes
Loading notes...