definition

Entropy as Amount of Surprise

Shannon entropy is a number assigned to a probability distribution that measures the amount of surprise or uncertainty it contains: a certain event (probability 1) has zero entropy because its occurrence conveys no information, while more spread-out distributions have higher entropy.

definitionpending

Speaker

Tai-Danae Bradley

Evidence Quote

“I think of the entropy of that list of probabilities or that distribution as sort of the amount of surprise that's contained in it, or the amount of uncertainty.”

Source

174 | Tai-Danae Bradley on Algebra, Topology, Language, and Entropy— Sean Carroll's Mindscape
Created: 6/13/2026, 12:11:28 AM

Your notes

Loading notes...