factual

Free energy principle predicts dislike of surprise

From the free energy principle, organisms actively predict what comes next and don't want to be surprised, so models 'enjoy' easy-to-predict sequences—giving a model an easy sequence is like a treat—though Sholto counters that organisms also constantly seek out-of-reach bits of entropy, suggesting the optimal reward is something just slightly too hard to predict.

factualpending

Speaker

Trenton Bricken

Evidence Quote

“from the free energy principle perspective, you don't want to be surprised. So maybe it's that I don't feel surprised. I feel in control of my environment”

Source

Sholto Douglas & Trenton Bricken — How LLMs actually think— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:31:11 AM

Your notes

Loading notes...