definition
Statistical Significance Misstated as Result Being Real
Statistical significance does not mean a result is almost certainly not due to noise; it only means that IF there were nothing but noise, the chance of seeing something as extreme or greater is less than 1 in 20—a conditional statement people routinely garble.
definitionpending
Speaker
Andrew GelmanEvidence Quote
“statistical significance does not say that your result is almost certainly not due to noise. It says: If there was nothing going on but noise, then the chance is only 1 in 20 that you'd see something as extreme or greater.”
Created: 6/13/2026, 12:23:45 AM
Your notes
Loading notes...