definition
Entropy as Amount of Surprise
Shannon entropy is a number assigned to a probability distribution that measures the amount of surprise or uncertainty it contains: a certain event (probability 1) has zero entropy because its occurrence conveys no information, while more spread-out distributions have higher entropy.
definitionpending
Speaker
Tai-Danae BradleyEvidence Quote
“I think of the entropy of that list of probabilities or that distribution as sort of the amount of surprise that's contained in it, or the amount of uncertainty.”
Created: 6/13/2026, 12:11:28 AM
Your notes
Loading notes...