counterfactual analysis
Evaluating a policy by comparing actual outcomes to what would have happened in the absence of the policy, not simply to outcomes before the policy.
As defined in Peltzman on Regulation 11/13/2006
Where it comes up · 1
Most important claims · 7 of 7Search all claims for “counterfactual analysis” →
- Demand for safety rises with income, so over time cars would become safer even without regulation; the historical record from the early automobile era to the 1960s shows gradual improvement in safety before regulation, and an economist would attribute that to wealth-driven demand.Peltzman on Regulation 11/13/2006
- The correct method for judging safety regulation is counterfactual: compare actual outcomes with what would have happened without regulation, and because safety had been improving without government pushing, a decline in deaths after regulation does not prove regulation helped.Peltzman on Regulation 11/13/2006
- The 55 mile per hour national speed limit is an example of the flawed before-and-after analysis: fatalities were falling steadily before the law took effect, at a similar rate, so the post-law decline does not show that the law had a significant effect, although it may have had some marginal impact.Peltzman on Regulation 11/13/2006
- Methodologically, the right question for regulation is not whether deaths declined but what the world would have looked like without regulation; the comparison shows little or no effect for the auto regulation studied.Peltzman on Regulation 11/13/2006
- The National Highway Traffic Safety Administration publishes a chart comparing traffic deaths before and after regulation, implying that regulation produced the decline, which misses the correct comparison with what would have happened without regulation.Peltzman on Regulation 11/13/2006
- Voters do not evaluate regulation through counterfactual analysis; they use a gross filter such as whether the country is on the right or wrong track, so policy is judged on general impressions rather than on the careful comparisons economists make.Peltzman on Regulation 11/13/2006
- Economists tend to differ from the general population on safety regulation because they compare a world with regulation to a counterfactual world without it, rather than simply observing that safety improved.Peltzman on Regulation 11/13/2006