causal

Field priors determine false positive vs exaggeration

Whether a significant small-sample result is a complete false positive or merely an exaggerated true effect depends on the field's prior probability of real effects: in fields with strong theory and prior evidence you tend to get inflated-but-real effects, whereas in agnostic, high-noise fields searching in the dark, almost any significant result is a false positive.

causalpending

Speaker

John Ioannidis

Evidence Quote

“If you are working in a field where you are just completely agnostic--black box, just searching in the dark, and actually in a field where there's not much to be discovered, just tons of noise--practically, then, if it's all noise, no matter what significant results you get it will be a false positive.”

Source

John Ioannidis on Statistical Significance, Economics, and Replication— EconTalk
Created: 6/13/2026, 12:20:10 AM

Your notes

Loading notes...