definition

Statistical Significance Misstated as Result Being Real

Statistical significance does not mean a result is almost certainly not due to noise; it only means that IF there were nothing but noise, the chance of seeing something as extreme or greater is less than 1 in 20—a conditional statement people routinely garble.

definitionpending

Speaker

Andrew Gelman

Evidence Quote

“statistical significance does not say that your result is almost certainly not due to noise. It says: If there was nothing going on but noise, then the chance is only 1 in 20 that you'd see something as extreme or greater.”

Source

Andrew Gelman on Social Science, Small Samples, and the Garden of the Forking Paths— EconTalk
Created: 6/13/2026, 12:23:45 AM

Your notes

Loading notes...