definition

Information Is the Reduction of Uncertainty

Shannon mathematically defined information as the reduction of uncertainty — formalized by the analogy of navigating a city randomly versus with a map, where the difference is a measure of information — and showed that information is the negative of thermodynamic entropy, connecting the science of information to statistical physics; this makes information a precise mathematical quantity, not merely a metaphor.

definitionpending

Speaker

David Krakauer

Evidence Quote

“shannon mathematicized that concept and said that is the reduction of uncertainty”

Source

40 - Complexity Stupidity— Making Sense with Sam Harris
Created: 6/14/2026, 1:54:31 AM

Your notes

Loading notes...