factual

Tech Experiments Are Context-Specific Not Generalizable

Unlike economists' experiments aimed at generalizable parameters (risk aversion, class size effects), tech firms' 10,000 experiments are specific to their interface and often compare black-box algorithms, so even if published they would not reveal fundamental generalizable truths—the firms are not hiding social science, that's simply not what the experiments are about.

factualpending

Speaker

Susan Athey

Evidence Quote

“even if they were publishing it, these wouldn't be fundamental truths that were generalizable.”

Source

Susan Athey on Machine Learning, Big Data, and Causation— EconTalk
Created: 6/13/2026, 12:14:45 AM

Your notes

Loading notes...