factual

Discarding Calibrated Systems on Single Misses Is Irrational

A well-calibrated forecasting system that says 75% will be wrong 25% of the time, so throwing out the system every time it lands on the wrong side of 'maybe'—as Leonhardt did with prediction markets after the Obamacare ruling—would leave you with no well-calibrated forecasting systems at all.

factualpending

Speaker

Philip Tetlock

Evidence Quote

“When they say there's a 75% likelihood of something happening, it's pretty close to a 75% likelihood. Which means that 25% of the time it doesn't happen.”

Source

Philip Tetlock on Superforecasting— EconTalk
Created: 6/13/2026, 12:26:35 AM

Your notes

Loading notes...