causal

Bias arises from trying to find something

Many of the biases that operate in research share a common denominator: people are trying to find something rather than trying not to find something, leading them to change analyses, add observations, or keep trying until they get a statistically significant p-value, which—when added to low power—causes false-positive rates and effect exaggeration to skyrocket.

causalpending

Speaker

John Ioannidis

Evidence Quote

“someone is trying to maybe sometimes change the analysis a little bit or try another analytical mode, add some more observations or do a few more experiments or keep trying until they get the statistically significant p-value, somehow.”

Source

John Ioannidis on Statistical Significance, Economics, and Replication— EconTalk
Created: 6/13/2026, 12:20:10 AM

Your notes

Loading notes...