Randomized Control Trial
An experimental study design in which participants are randomly assigned to treatment or control groups to measure causal effects of an intervention.
As defined in cwt_chris-blattman
Other definitions
A statistical and experimental tool, introduced around the 1940s, in which subjects are randomly assigned to treatment or control groups to establish causal effects.
Peter Attia on Lifespan, Healthspan, and Outlive
Where it comes up · 25
- Susan Athey on Machine Learning, Big Data, and Causation8 claims
- Jacob Stegenga on Medical Nihilism8 claims
- Adam Cifu on Ending Medical Reversal6 claims
- Chris Blattman on Chickens, Cash, and Development Economics5 claims
- Emily Oster on Cribsheet5 claims
- What Modern Medicine Gets Wrong (with Marty Makary)4 claims
- Jennifer Doleac on Crime3 claims
- Michael Faye and Paul Niehaus on GiveDirectly3 claims
and 17 more
Most important claims · 10 of 65Search all claims for “Randomized Control Trial” →
- Interventions that look effective in observational studies often turn out to be ineffective or harmful when tested in randomized control trials, illustrating the general pattern that the better the methods get, the less effective interventions appear—a recurring trope in evidence-based medicine ('medical reversal').Jacob Stegenga on Medical Nihilism
- Randomized experiments require the assumption that treating one person doesn't affect others so that untreated people serve as a control, but all economic models recognize that everyone is connected through markets and networks; this creates a deep tension because experiments miss the broader General Equilibrium effects, which is especially important for cash since every dollar given is spent somewhere, having a one-for-one accounting impact on others.Michael Faye and Paul Niehaus on GiveDirectly
- Dr. Gideon Lack, noticing Jewish children in Israel (who eat the peanut snack Bamba early) had far lower peanut allergy rates than Jewish children in London, ran a randomized controlled trial of 640 children and proved that avoiding peanuts in the first years of life raised the rate of peanut allergies almost ninefold later in childhood, identifying the cause of the epidemic.What Modern Medicine Gets Wrong (with Marty Makary)
- RCTs for regulatory approval systematically exclude the elderly, people with comorbidities, and people on multiple drugs (polypharmacy)—precisely the features that empirical evidence shows increase a drug's harms—so when the drug is later prescribed to those very populations, trials have systematically underestimated the real-world harm profile.Jacob Stegenga on Medical Nihilism
- Trials stopped early because an effect looks dramatic tend to overestimate the benefit of a treatment, because across many studies outcomes vary by chance and stopping at a favorable moment captures the high-variance positive result rather than the true effect.Adam Cifu on Ending Medical Reversal
- Because randomized trials are statistically valid only for what they measure (short-term outcomes) and running long experiments is expensive, tech firms are systematically biased toward short-term improvements; summing all experiments might predict 300% revenue growth while actual growth was 10%, because interface changes confuse users initially and firms innovate in the wrong, short-term dimensions while missing radical long-term improvements.Susan Athey on Machine Learning, Big Data, and Causation
- Studying the effect of a single food is nearly impossible because adding one food to a diet means subtracting another, so an apparent effect could be from the food introduced or the food displaced, and preparation methods further confound the measured health impact.Julia Belluz on Epidemiology, Nutrition, and Metabolism
- Because A/B tests provide objective causal validation, tech firms can decentralize innovation: thousands of engineers, even summer interns, can write code, test it, and ship it live to users within days as long as the randomized control trial shows users responded positively and the change follows the rules.Susan Athey on Machine Learning, Big Data, and Causation
- Contrary to the popular image of lone-genius leaps like Steve Jobs designing fonts, most tech innovation is incremental, and the A/B test is the most impactful business process innovation in a long time; firms like Google run over 10,000 randomized control trials per year, and nothing ships without passing one.Susan Athey on Machine Learning, Big Data, and Causation
- The study persuaded factory owners with large unskilled workforces to randomize hiring: among ~150 qualified applicants for ~50 unskilled openings, 50 were offered the factory job, 50 were offered a $300 cash grant plus five days of business consulting, and 50 formed a pure control group, all followed over a year to compare income, health, and career trajectories.Chris Blattman on Sweatshops