definition
Information And Entropy Are Opposites Often Confounded
Information is the opposite of entropy: entropy is about what we don't know, and information equals the difference between maximum entropy and actual entropy, so it is always positive. Confounding the two (as the Shannon-Weaver book did) produces persistent misunderstandings, including the mistaken 'neg-entropy' notion that drops the crucial maximum-entropy term.
definitionpending
Speaker
Christoph AdamiEvidence Quote
“information is just minus entropy or what bunch of people have called neg entropy, right? Which is nonsense. It's forgetting the first term, which is the maximum entropy”
Created: 6/13/2026, 3:37:03 AM
Your notes
Loading notes...