Gaussian
Pertaining to the normal (bell-curve) distribution; the assumption under which Granger causality and transfer entropy are exactly equivalent.
As defined in 168 | Anil Seth on Emergence, Information, and Consciousness
Where it comes up · 2
- Nassim Taleb — Meditations on Extremistan7 claims
- 168 | Anil Seth on Emergence, Information, and Consciousness1 claim
Most important claims · 8 of 8Search all claims for “Gaussian” →
- Granger causality (from autoregressive statistical modeling) and transfer entropy (from information theory) are conceptually the same idea, and Barnett and Barrett proved they are exactly equivalent when variables are Gaussian (one being half the other), connecting two different mathematical domains and allowing autoregressive models to be translated directly into bits-per-second of information flow.168 | Anil Seth on Emergence, Information, and Consciousness
- When you exponentiate a Gaussian distribution, you get a log-normal; when you exponentiate a Gamma or exponential, you get a Pareto; when you exponentiate a Pareto, you get a log-Pareto—each transformation moves the distribution to fatter tails.Nassim Taleb — Meditations on Extremistan
- In Gaussian distributions, the expected deviation above 3 sigma is slightly more than 3 sigma, and as you move to higher sigmas the expected additional deviation shrinks, but in extremist time the scale stays the same—the expected life expectancy of a Gaussian-distributed entity at 100 years old is about 2 additional years, but for a Pareto distribution it scales the same way.Nassim Taleb — Meditations on Extremistan
- Every statistical problem needs a new class of estimators adapted to the problem; you cannot make general claims using Gaussian-derived tools, and this principle should guide statistical methodology rather than trying to force all problems into standardized frameworks.Nassim Taleb — Meditations on Extremistan
- The shadow mean is the true mean of the data-generating process, which is often substantially higher than the empirical sample mean for fat-tail distributions; for warfare, the shadow mean is approximately three times higher than what historical records show.Nassim Taleb — Meditations on Extremistan
- Value-at-Risk is flawed not only because it ignores what happens in the tail beyond the confidence interval, but also because the probability distribution itself, when transformed from a continuous distribution to a bounded [0,1] space, becomes convex or concave, making small forecasting errors explosive.Nassim Taleb — Meditations on Extremistan
- Hypothesis testing and standardized statistics are fundamentally different from probability theory, with hypothesis testing being a separate discipline—you cannot do non-standard statistics without understanding probability, which explains why most practitioners fail.Nassim Taleb — Meditations on Extremistan
- Large language models have not produced original scientific insights because they operate by probabilistic matching (reflecting consensus) rather than by novelty-seeking; they would need to make errors or produce counterintuitive outputs to enable genuine discovery, but as designed they reproduce what makes sense given current information.Nassim Taleb — Meditations on Extremistan