factual

Bayesian Second Law Reconciles Entropy and Learning

There is a puzzle that entropy increases while entropy also measures our ignorance and we continually learn about the world (so a good Bayesian seemingly sees a reversed arrow of time as entropy falls); Carroll's Bayesian Second Law resolves this by deriving a quantity, involving relative entropy, that increases even when measurements that reduce uncertainty are included.

factualpending

Speaker

Sean Carroll

Evidence Quote

“in some weird sense, a good Bayesian sees a reversed arrow of time because you just learn more and more about the world, and therefore the entropy of the world goes down.”

Source

AMA | October 2021— Sean Carroll's Mindscape
Created: 6/13/2026, 12:24:06 AM

Your notes

Loading notes...