causal

Subconscious Bias Worse Than Outright Fraud

Outright fraud is not the real problem in science because fraud is detectable once found; the deeper problem is subconscious bias, where a researcher who believes a hypothesis is true reinterprets a null result as a flawed sample or wrong specification and re-runs the study with altered terms until randomness produces a significant result, which then invalidates the classical tests of significance.

causalpending

Speaker

Russ Roberts

Evidence Quote

“The real problem is subconscious fraud. You run the equation--and they don't get any effect. And you think, well, priming is true, of course; so you use the right words... once you start altering the terms of the experiment that way, the classical tests of significance no longer hold.”

Source

Ed Yong on Science, Replication, and Journalism— EconTalk
Created: 6/13/2026, 12:25:57 AM

Your notes

Loading notes...