causal

Subgroup Analysis Reintroduces Selection Bias

Once you stop analyzing the full randomized groups (intention-to-treat) and instead analyze only the subset of lottery winners who actually obtained Medicaid, you reintroduce the very selection-bias problem randomization was meant to eliminate, because you no longer know which losers are comparable to the self-selected enrollees; Manzi calls this introducing 'the bacillus of econometrics.'

causalpending

Speaker

Jim Manzi

Evidence Quote

“It's the bacillus of econometrics, is introduced, because you have to basically do some kind of modeling to say, I'm going to look at the characteristics of those individuals who are the subset of those who won the lottery, who actually got the treatment that I'm interested in”

Source

Jim Manzi on the Oregon Medicaid Study, Experimental Evidence, and Causality— EconTalk
Created: 6/13/2026, 12:13:56 AM

Your notes

Loading notes...