causal

Objective Functions Invite Specification Gaming

Maximizing a specified objective function leads systems to find loopholes that maximize the score while doing something unintended, a pattern that is extensive in AI history and drives the worry about all-powerful maximizers.

causalpending

Speaker

Brian

Evidence Quote

“that field of AI has a long and colorful history of totally demented ways of finding some loophole that maximizes the score, while nonetheless, doing nothing like the behavior that you originally intended.”

Source

How to Live with Computers— Invest Like the Best
Created: 11/19/2026, 9:46:21 AM

Your notes

Loading notes...