field experiment
An experiment conducted in a real-world setting (rather than a lab) with random assignment to treatment and control.
As defined in John List on Scale, Uber, and the Voltage Effect
Where it comes up · 6
- Andrew Gelman on Social Science, Small Samples, and the Garden of the Forking Paths2 claims
- Susan Mayer on What Money Can't Buy2 claims
- Twenty Years of Freakonomics (with Stephen Dubner)1 claim
- Luigi Zingales on Incentives and the Potential Capture of Economists by Special Interests1 claim
- Chris Blattman on Sweatshops1 claim
- John List on Scale, Uber, and the Voltage Effect1 claim
Most important claims · 8 of 8Search all claims for “field experiment” →
- When Uber added tipping and scaled it nationwide, it produced a textbook competitive-market result: drivers supplied more labor hours (some new entrants, some working more), which increased empty-car driving, and that increase exactly offset the wage gains from tips—leaving hourly wages identical pre-tip and post-tip even though the policy looked good when only 5% of drivers had it.John List on Scale, Uber, and the Voltage Effect
- The belief that a field experiment automatically delivers a valid result—identification from randomization plus external validity from the real-world setting—is mistaken; if the study is too small and noisy, neither identification nor generalizability is sufficient to produce a reliable finding.Andrew Gelman on Social Science, Small Samples, and the Garden of the Forking Paths
- Simply reminding parents to get their kids to school and giving them simple tips—such as putting the child's backpack by the door the night before—reduces chronic absenteeism by something like 20% at almost no cost, illustrating that we should be more open-minded about low-cost behavioral solutions.Susan Mayer on What Money Can't Buy
- When an economist partners with a firm for proprietary data or a field experiment, even without being prevented from publishing, a subtle quid pro quo leads the researcher to fine-tune the work and avoid examining the worst findings, so that even integrating across all such studies the aggregate picture cannot be unbiased because the data are controlled by interested parties.Luigi Zingales on Incentives and the Potential Capture of Economists by Special Interests
- Real field data, even small and hand-curated like the bagel man's, has value because it carries context, whereas decontextualized experimental data (e.g., a Dictator Game subject refusing money because the experimenter wore torn jeans) can be deeply misleading if the reason behind the recorded behavior is unknown.Twenty Years of Freakonomics (with Stephen Dubner)
- The chief value of field experiments is not the point estimate but that they force economists out of their offices to interact with the world, follow people over time, and discover that their assumptions are often not just false but sometimes the opposite of true, which permanently changed Blattman's view of development and where growth comes from.Chris Blattman on Sweatshops
- By reminding parents to read, telling them exactly how much they actually read (countering their optimistic self-estimates), and getting them to set and stick to goals, Mayer's experiment doubled the amount of time preschool parents read to their children in a non-invasive way that parents liked.Susan Mayer on What Money Can't Buy
- Enthusiasm for deworming charities was driven by a field experiment showing large benefits across many dimensions, but when applied on a very large scale it did not work as well; as with priming, the underlying intervention may be net beneficial, with the magnitude and individual variation being the real points of contention.Andrew Gelman on Social Science, Small Samples, and the Garden of the Forking Paths