robustness checks
Reporting plausible variations on an analysis to show that a result does not depend on arbitrary modeling choices.
As defined in Joshua Angrist on Econometrics and Causation
Where it comes up · 1
Most important claims · 2 of 2Search all claims for “robustness checks” →
- Leamer's complaint about arbitrary specification choices filtered into empirical practice as the now-standard expectation that researchers report plausible robustness checks, and increasingly as pre-commitment to analysis plans in randomized trials.Joshua Angrist on Econometrics and Causation
- The differences-in-differences method depends on the assumption that treatment and control groups would have moved in parallel absent treatment; this is partly testable, and many panel results disappear once you allow group-specific trends, as happened with Angrist's compulsory-attendance-law study.Joshua Angrist on Econometrics and Causation