Peer review
The academic process of vetting research by experts before publication; contrasted with open source's publish-first model.
As defined in cwt_balaji-srinivasan
Other definitions
The process by which scientific papers are evaluated by independent experts in the field before publication; a form of quality gatekeeping that ensures work meets standards of rigor and validity, though imperfect.
Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should doProcess where experts validate academic work before publication, which gives journal content its credibility.
Informa: Where Industries Meet
Where it comes up · 32
- Adam Mastroianni on Peer Review and the Academic Kitchen10 claims
- Authors of "THE AI CON" discussing the problematic hype about AI & what those working tech should do5 claims
- Tim Urban - Idea Labs and High-Rung Thinking - [Invest Like the Best, EP.317]4 claims
- 90 | David Kaiser on Science, Money, and Power4 claims
- Weightlifting Is A Waste of Time & So Is Cardio - Dr John Jaquish4 claims
- Conversations with Tyler 2025 Retrospective3 claims
- 119 | Musa al-Gharbi on the Value of Intellectual Diversity3 claims
- Ed Boyden2 claims
and 24 more
Most important claims · 10 of 67Search all claims for “Peer review” →
- The modern grant-making system—where autonomous researchers and federal agencies enter a legalistic business contract rather than a charity gift—was deliberately engineered during World War II by Vannevar Bush, who, being anti-New Deal and wary of anything resembling socialist central planning, structured federal research support as a free-market deal between two co-equal autonomous parties.90 | David Kaiser on Science, Money, and Power
- The centralized system in which doing science means submitting a paper to a journal where it undergoes peer review before publication did not emerge until the middle of the 20th century; before that, scientific communication was a diverse ecosystem of letters, magazines, and journalism-like coverage, and journals affiliated with associations operated on different incentives.Adam Mastroianni on Peer Review and the Academic Kitchen
- The growing reliance on private foundation money for physics is in some sense a return to the patronage model that prevailed in the 1920s-30s United States and earlier eras like 17th-century Italy, except that foundations provide a more institutionalized, stable buffer—often using peer review and separating donor wishes from researchers—than the foibles of an individual patron.90 | David Kaiser on Science, Money, and Power
- Because physics has repeatedly suffered from being hooked on a funding monoculture that inevitably fails, the sustainable path forward is a diversified portfolio—combining federal, state, local, foundation, private industrial, and carefully vetted individual sources—with buffers like peer review, academic freedom, and freedom to publish laid out in advance.90 | David Kaiser on Science, Money, and Power
- When the value that can be won by gaming a system rises, gaming increases; in academia, where salaries were once compressed and stakes small, large rewards near the top now make gaming the system necessary to reach tenure and richly rewarded thereafter, so the people most likely to survive are those skilled at gaming—including, increasingly, outright fraud—rather than passionate truth-seekers.Misinformation and the Three Languages of Politics (with Arnold Kling)
- The system of government funding university research is a 20th-century invention codified by Vannevar Bush, who—struck by how technology won World War II—laid down rules at the close of the war to push research out to conveniently distributed universities, pair research with workforce education, set national priorities through mission agencies while remaining hands-off, and bake peer review into the NSF as part of the 'secret sauce.'324 | Elizabeth Mynatt on Universities and the Importance of Basic Research
- The modern scientific establishment works as mass-scale Genie-making because hypotheses are attacked by institutions and only accepted when no one can show they are wrong, which produced advances like quantum mechanics and relativity, and it allows collaboration across language and geography.Tim Urban - Idea Labs and High-Rung Thinking - [Invest Like the Best, EP.317]
- The growth of knowledge is a process where experts are continually overturned by a new generation of experts, but the challenge must come from others who understand the field, its rules of evidence, and what has already been accomplished—not from laypeople citing personal anecdote.108 - Defending The Experts
- Institutions like peer review and review boards are premised on adversarial clash between people with diverse frameworks to push toward more objective conclusions; but when all decision-makers share the same axioms and blind spots, these very processes amplify biases instead of correcting them.119 | Musa al-Gharbi on the Value of Intellectual Diversity
- People who are more worried about AI risk than Cowen should go through peer review and develop a literature, because the point of a literature is to surface the critical questions through deliberate scrutiny; their refusal to do so, combined with peer review, market prices, and superforecasters not being with them, puts the burden of proof on them.Conversations with Tyler 2025 Retrospective