Sample Size
The number of independent observations available for analysis; small sample sizes fundamentally limit statistical confidence.
As defined in Nate Silver
Other definitions
The number of observations available; low sample size means outcomes are dominated by randomness and are harder to read reliably.
Data, Decisions, and Basketball
Where it comes up · 2
- Nate Silver4 claims
- Data, Decisions, and Basketball1 claim
Most important claims · 5 of 5Search all claims for “Sample Size” →
- Opportunity is greatest in sports with more randomness, less consensus on value creation, low sample sizes, and little coach control over possession, such as soccer and hockey, but only if you build or find data sets others have not seen.Data, Decisions, and Basketball
- As the world avoids common mistakes, we are increasingly left talking only about weird, hard-to-forecast events; models work well as heuristics in normal conditions but handle edge cases poorly due to nonlinearity and small sample sizes—the analytical advantage of models lies mainly in the baseline cases, and forecasters should evaluate the territory covered in routine plays rather than only the spectacular ones at the edge of the range.Nate Silver
- Although less glamorous, Senate and House races provide larger quasi-independent samples that make a better test for forecasting models than presidential elections; the danger is correlated error—as in the most recent Senate races where polls were off by three or four points all in the same direction, causing underdog Republicans to win.Nate Silver
- When you have a small sample size—such as roughly 15 relevant primary elections going back to 1972—there is nothing you can do to make it not a sample size of 15; no matter how compelling the theoretical rationalization layered on top, the empirical evidence remains fundamentally limited.Nate Silver
- Analysis of many Senate races over time—where ideology is measurable through legislative records and sample sizes are large—shows there is a price for extremism: a candidate like Ted Cruz would probably cost about three or four points relative to the median generic Republican, a penalty that can be overcome only under conditions like a recession or a flawed opponent.Nate Silver