causal

Researcher Degrees of Freedom Exploit Chance

Even without conscious fraud, researchers make many analysis decisions (which participants to exclude, which covariates to include) and are subtly influenced to choose those that make results look better; these unconstrained choices leverage chance to produce favorable results, which is why a constrained replication using the same fixed choices often fails to reproduce the original effect.

causalpending

Speaker

Brian Nosek

Evidence Quote

“we are leveraging chance. We are taking our opportunities to get results that look good for us.”

Source

Brian Nosek on Truth, Science, and Academic Incentives— EconTalk
Created: 6/13/2026, 12:17:26 AM

Your notes

Loading notes...