factual

Tech experiments are not generalizable truths

Most of the 10,000 tech experiments are not designed to uncover fundamental generalizable truths about the world; they are specific to a firm's interface, often comparing two black-box algorithms where you never learn why one worked better, so even if published they would not yield generalizable parameters like risk aversion or class-size effects that economists seek.

factualpending

Speaker

Susan Athey

Evidence Quote

“even if they were publishing it, these wouldn't be fundamental truths that were generalizable.”

Source

Susan Athey on Machine Learning, Big Data, and Causation— EconTalk
Created: 6/13/2026, 3:35:37 AM

Your notes

Loading notes...