normative

Exploratory work should be honestly labeled exploratory

Research obtained through a garden of many analytic paths and countless analyses should be honestly acknowledged as entirely exploratory data-dredging rather than dressed up as pre-registered; that is fine provided everyone knows what it is, and the specific emergent recipe can then be pre-registered and tested on a different dataset to see if it replicates.

normativepending

Speaker

John Ioannidis

Evidence Quote

“saying that this is pre-registered is just trying to fool others and fool ourselves... someone could preregister a study that follows that exact same meandering recipe that emerged from that exploration.”

Source

John Ioannidis on Statistical Significance, Economics, and Replication— EconTalk
Created: 6/13/2026, 12:20:10 AM

Your notes

Loading notes...