file drawer problem
The bias arising because unpublished studies (mostly null or unexciting results) sit unseen in researchers' files, making the published literature unrepresentative.
As defined in Brian Nosek on Truth, Science, and Academic Incentives
Where it comes up · 4
- Brian Nosek on Truth, Science, and Academic Incentives2 claims
- 158 - Understanding Humans In The Wild1 claim
- 95 | Liam Kofi Bright on Knowledge, Truth, and Science1 claim
- AMA | May 20231 claim
Most important claims · 5 of 5Search all claims for “file drawer problem” →
- Because positive and innovative results are more publishable than negative or confirmatory ones, the unpublished 'file drawer' (gray literature) systematically differs from the published record, so knowing what is in both literatures is essential to understanding what is really going on.Brian Nosek on Truth, Science, and Academic Incentives
- The file drawer problem biases the scientific literature: positive results suggesting a new effect are exciting and get published in high-prestige journals read by many, while null results or replications are hard to publish and often remain only with the scientist who produced them—creating a massive bias in what information reaches the community. This problem was known long before the replication crisis, which has prompted cleaning up house that should have happened earlier.95 | Liam Kofi Bright on Knowledge, Truth, and Science
- As a consequence of psychology's replication crisis, open-science efforts (sharing datasets and code, pre-registration) have become increasingly important to prevent bad research practices like p-hacking and the file-drawer problem, and psychology has arguably emerged stronger as a result.AMA | May 2023
- The science supporting meditation's benefits is thinner than enthusiasts acknowledge—lacking enough randomized controlled trials that isolate meditation from other activities, with weak objective outcomes, strong placebo vulnerability, and a likely file-drawer problem from believer-researchers—so its benefits, while probably real for stress and mindfulness, are over-hyped and need rigorous boundary-condition study.158 - Understanding Humans In The Wild
- PsychFileDrawer, started by Hal Pashler and colleagues, lets researchers post a short 15-minute summary of unpublished replication results, providing a low-cost repository to expose the file drawer and connect researchers interested in the same findings without the burden of formal publication.Brian Nosek on Truth, Science, and Academic Incentives