causal

Conceptual Replications Created Illusion of Confirmation

Roughly 300 papers cited the original priming study as 'conceptual replications,' each testing slightly different conditions and finding some pattern, which created an overwhelming illusion of confirmation; this is itself a forking-paths problem because contradictory results can always be rationalized into apparent support.

causalpending

Speaker

Andrew Gelman

Evidence Quote

“This can go on forever. There's really no way of stopping it. The only way of stopping it, perhaps, is to do... brute force running a replication.”

Source

Andrew Gelman on Social Science, Small Samples, and the Garden of the Forking Paths— EconTalk
Created: 6/13/2026, 12:23:45 AM

Your notes

Loading notes...