normative

Pre-analysis plans waste heterogeneity information

Pre-analysis plans prevent subgroup data mining but are inefficient because most drugs genuinely have heterogeneous effects; forcing researchers to specify all possible subgroups in advance throws away the valuable information that data could reveal afterward about which groups respond.

normativepending

Speaker

Susan Athey

Evidence Quote

“you are actually throwing away good information by not letting the data tell you afterwards what the treatment effects were for different groups.”

Source

Susan Athey on Machine Learning, Big Data, and Causation— EconTalk
Created: 6/13/2026, 3:35:37 AM

Your notes

Loading notes...