normative

Statistical Significance Versus Policy Significance

Statistical significance (an effect distinguishable from chance) is routinely and misleadingly conflated with practical or policy significance (an effect large enough to matter); an expensive intervention like Medicaid expansion could produce a statistically significant but policy-insignificant effect, such as a sub-one-point reduction in blood pressure.

normativepending

Speaker

Russ Roberts

Evidence Quote

“If the effect is small, then the effect could be statistically significant but policy-wise insignificant.”

Source

Jim Manzi on the Oregon Medicaid Study, Experimental Evidence, and Causality— EconTalk
Created: 6/13/2026, 12:13:56 AM

Your notes

Loading notes...