factual

Medical Reversal: Significant Findings Fail Randomized Trials

As documented in Adam Cifu's Medical Reversal, many multivariate analyses showing statistical significance for new techniques or devices fail to hold up when subjected to randomized controlled trials—a particularly consequential version of the replication failure because it involves life, death, and large sums of money.

factualpending

Speaker

Russ Roberts

Evidence Quote

“many multivariate analyses and studies which show statistical significance of some new technique, or new device--when then put into a randomized control trial, do not hold up.”

Source

Andrew Gelman on Social Science, Small Samples, and the Garden of the Forking Paths— EconTalk
Created: 6/13/2026, 12:23:45 AM

Your notes

Loading notes...