two sigma rule
The convention of accepting a finding as statistically significant when it is two standard deviations from zero, corresponding to 95% confidence and a 1-in-20 chance of being a fluke; equivalent to a t-statistic of 2.
As defined in Campbell Harvey on Randomness, Skill, and Investment Strategies
Where it comes up · 1
Most important claims · 4 of 4Search all claims for “two sigma rule” →
- Harvey demonstrated that a strategy looking highly attractive at 2.5-sigma was generated from random numbers with zero true skill: simulating 200 random strategies (mean zero, S&P-like volatility), the tails inevitably produced one strategy that appeared 2.5-sigma above zero and another 2.5-sigma below, proving that apparent significance can be entirely a product of selecting from many random series.Campbell Harvey on Randomness, Skill, and Investment Strategies
- When the number of tests increases, the standard two-sigma (95% confidence) rule becomes unreliable because random chance will produce apparent significant findings; with 20 tests you expect roughly one false positive at the 5% level, so the cutoff must be raised as in physics' five-sigma standard.Campbell Harvey on Randomness, Skill, and Investment Strategies
- Statistical significance (whether a relationship differs from random, e.g. via the two-sigma rule) is conceptually distinct from economic significance (whether the effect is actually large enough to matter); a finding can be statistically significant yet trivially small in real-world terms.Campbell Harvey on Randomness, Skill, and Investment Strategies
- Moving from two-sigma to five-sigma is not roughly twice as strict; two-sigma implies a 1-in-20 fluke chance while five-sigma implies roughly a 1-in-1.5-million fluke chance, because probabilities fall off non-linearly as you move further into the tail.Campbell Harvey on Randomness, Skill, and Investment Strategies