definition

P-Value Is a Statement About Counterfactual Analyses

A reported p-value is literally a statement about what the researcher would have done had the data been different; because it is the probability of a more extreme result under random data, claiming significance implicitly asserts the same analysis would have been run on any other dataset, so the burden of justifying that counterfactual lies on the author, not the critic.

definitionpending

Speaker

Andrew Gelman

Evidence Quote

“your p-value is literally a statement about what you would have done had the data been different. So the burden is on you.”

Source

Andrew Gelman on Social Science, Small Samples, and the Garden of the Forking Paths— EconTalk
Created: 6/13/2026, 12:23:45 AM

Your notes

Loading notes...