causal

Under-tuned replications as alternative decline explanation

An alternative or contributing explanation for smaller replication effects is that original authors tuned their studies to the particulars of their sample and setting to maximize the effect, while replications conducted in new settings were not tuned enough—sometimes due to subtle, unobservable factors like language or facial expressions—to obtain the same strong effect.

causalpending

Speaker

Brian Nosek

Evidence Quote

“it's possible that those original authors designed their study in such a way that it would obtain the largest possible effect they could in that original setting. And then, when the replication did it in the new setting, they didn't change it enough or tune it enough”

Source

Brian Nosek on the Reproducibility Project— EconTalk
Created: 6/13/2026, 12:25:28 AM

Your notes

Loading notes...