causal

Many characteristics guarantee spurious subgroups

If you measure a thousand characteristics on a thousand patients and look for what the 15 best-responding patients share, you will almost certainly find common traits by chance alone, letting you 'prove' a spurious subgroup treatment effect even when the drug has no real effect; this is why the FDA requires pre-analysis plans.

causalpending

Speaker

Susan Athey

Evidence Quote

“if you have a thousand characteristics of them, it's almost certain that you can find some things that they share in common... so you can pretty much always find a positive effect for some subgroup.”

Source

Susan Athey on Machine Learning, Big Data, and Causation— EconTalk
Created: 6/13/2026, 3:35:37 AM

Your notes

Loading notes...