factual

Crowdsourced replication design to limit selection bias

The Reproducibility Project minimized selection bias by defining a fixed sampling frame of eligible studies, releasing them slowly, requiring interaction with original authors for good-faith replications, and making the entire process and data transparent on the Open Science Framework, so that no replicator could cherry-pick studies they wanted to debunk.

factualpending

Speaker

Brian Nosek

Evidence Quote

“we define a sampling frame of a particular set of studies that were eligible for replication. And then we slowly made studies available from that set, to minimize selection bias and to maximize just trying to have enough flexibility”

Source

Brian Nosek on the Reproducibility Project— EconTalk
Created: 6/13/2026, 12:25:28 AM

Your notes

Loading notes...