← Jargon

Jargoninformation theory· 6 claims· 5 episodes

Shannon entropy

A number assigned to a probability distribution measuring the amount of surprise, uncertainty, or information it contains; zero for a certain outcome and maximal for a uniform distribution.

As defined in 174 | Tai-Danae Bradley on Algebra, Topology, Language, and Entropy


Where it comes up · 5