factual

The Garden of Forking Paths obscures multiplicity

In many analyses researchers cannot even count their multiplicity burden because they travel down a garden of forking paths—many decision nodes with many options, some choices subconscious—so unlike genetics where variants can be counted and corrected, there is no direct way to correct for the true number of analytic choices made.

factualpending

Speaker

John Ioannidis

Evidence Quote

“In many other situations we don't really know exactly how much multiplicity we are dealing with... it's very difficult to estimate the exact multiplicity burden in that case.”

Source

John Ioannidis on Statistical Significance, Economics, and Replication— EconTalk
Created: 6/13/2026, 12:20:10 AM

Your notes

Loading notes...