causal

Big data is overpowered, making significance meaningless

Big data studies have the opposite problem of old small studies: they are overpowered, so nominal statistical significance means almost nothing because virtually any analysis will be significant one way or another, leaving significance with little ability to discriminate real findings from flukes.

causalpending

Speaker

John Ioannidis

Evidence Quote

“statistical significance has very little discriminating ability to tell you which ones are the real needles and which are just flukes.”

Source

John Ioannidis on Statistical Significance, Economics, and Replication— EconTalk
Created: 6/13/2026, 12:20:10 AM

Your notes

Loading notes...