observational study
A study that analyzes data from people who did and did not receive a treatment without random assignment, making causal inference harder.
As defined in Jacob Stegenga on Medical Nihilism
Other definitions
A research study where investigators observe or measure characteristics without intervening; as opposed to randomized controlled trials where an intervention is applied; prone to confounding and reverse causation.
Outlive: The Science and Art of Longevity — Dr. Peter Attia
Where it comes up · 9
- Adam Cifu on Ending Medical Reversal3 claims
- Julia Belluz on Epidemiology, Nutrition, and Metabolism3 claims
- Ed Yong on Science, Replication, and Journalism2 claims
- Emily Oster on Pregnancy, Causation, and Expecting Better2 claims
- Robert Aronowitz on Risky Medicine2 claims
- John Ioannidis on Statistical Significance, Economics, and Replication2 claims
- Outlive: The Science and Art of Longevity — Dr. Peter Attia1 claim
- Jacob Stegenga on Medical Nihilism1 claim
and 1 more
Most important claims · 10 of 17Search all claims for “observational study” →
- Interventions that look effective in observational studies often turn out to be ineffective or harmful when tested in randomized control trials, illustrating the general pattern that the better the methods get, the less effective interventions appear—a recurring trope in evidence-based medicine ('medical reversal').Jacob Stegenga on Medical Nihilism
- When John Ioannidis randomly selected common foods from a cookbook and reviewed the literature, nearly every single food had numerous published studies showing it increased cancer risk and numerous others showing it decreased risk, demonstrating that the nutrition-cancer literature is so inconsistent it should breed skepticism about single-food health claims.Julia Belluz on Epidemiology, Nutrition, and Metabolism
- Medical reversal occurs when a widely adopted practice based on an observational study—accepted because it was peer-reviewed—is later overturned by a randomized controlled trial that finds the opposite, showing the practice should not be done or that something else should be done instead.John Ioannidis on Statistical Significance, Economics, and Replication
- A large population in an observational study is not sufficient to make its findings reliable; a study claiming ovary removal increases heart disease risk was unconvincing because, lacking a clinical trial, it could not establish that the women who chose the procedure were comparable to those who did not.Robert Aronowitz on Risky Medicine
- Controlling for confounders with statistics has a place, but you never know if you've fully adjusted for them; even sophisticated researchers controlling for a dozen-plus variables in the Nurses' Health Study couldn't capture how different the groups were, so observational results agree with RCTs only about 80% of the time and you can't tell when they're misleading.Adam Cifu on Ending Medical Reversal
- For questions where the noise is many orders of magnitude larger than the signal—such as single nutrients linked to disease outcomes—observational designs should be abandoned because they cannot recover such tiny effects; randomized or experimental trials minimizing confounding are needed, and continuing observational studies is largely a waste that may bias our thinking rather than provide preliminary insight.John Ioannidis on Statistical Significance, Economics, and Replication
- Per John Ioannidis, we should never take seriously any observational study about the impact of a single food or drink on human health, because the normal range of human dietary experience cannot be reliably measured this way, and such studies produce spurious findings like hazelnuts prolonging life by 12 years.Julia Belluz on Epidemiology, Nutrition, and Metabolism
- Observational epidemiological studies only look at phenomena in a population and can show associations between things but cannot establish that one thing causes another; they are supposed to be hypothesis-generating starting points, and you would need experimental studies to tease out cause and effect.Julia Belluz on Epidemiology, Nutrition, and Metabolism
- Chronic-disease epidemiology faces a crisis around small relative risks: a burgeoning industry produces observational studies finding that some tiny lifestyle or dietary factor statistically significantly raises risk, only for another study to reverse it the next day—leading some to argue that relative risks below about 7 should not even be published.Robert Aronowitz on Risky Medicine
- Observational studies are natural experiments where groups self-select or are selected into treatments, so the groups differ in many ways besides the intervention; in the estrogen case, women who took estrogen were younger, thinner, had better cholesterol and drank more, so their better outcomes likely reflected those traits rather than the estrogen itself.Adam Cifu on Ending Medical Reversal