backtesting
Testing a decision framework by applying it to past situations to see whether it would have produced good judgments.
As defined in Fin Moorhouse - Longtermism, Space, & Entrepreneurship
Other definitions
Practice of testing trading strategies or risk models against historical data to see how they would have performed, though past performance does not guarantee future results
MacroVoices #525 Lyn Alden: Iran Contagion, Inflation & Private Credit
Where it comes up · 10
- The Art of Trading Currencies, the World's Largest Market (w/ Dave Floyd and Brent Donnelly)1 claim
- Inside General Atlantic: How a $100B Growth Equity Firm Invests1 claim
- Bullet Proof Nest-Egg Advice From Tony Robbins and Ray Dalio | Forbes1 claim
- #108 Jim Simons (Money Printer)1 claim
- #43 Ray Dalio: Principles: Life and Work1 claim
- The Future of Venture Capital1 claim
- Fin Moorhouse - Longtermism, Space, & Entrepreneurship1 claim
- Dwarkesh Patel Podcast - The avalanche that hit math is coming for AI development1 claim
and 2 more
Most important claims · 10 of 10Search all claims for “backtesting” →
- Dalio began writing trading criteria into formulas and running historical data through them to test how well his rules would have worked, which became the fundamental foundation of the new Bridgewater.#43 Ray Dalio: Principles: Life and Work
- The all-weather portfolio achieved its worst loss of -3.95% in 75 years of backtesting (during the 2008 financial crisis), compared to the S&P 500's 51% decline, while maintaining average returns comparable to the market.Bullet Proof Nest-Egg Advice From Tony Robbins and Ray Dalio | Forbes
- The critique that quantitative investing amounts to 'driving with only the rear view mirror' through backtesting is only fair when a model is based purely on historical pattern-matching without a prior investment thesis or theoretical justification; most serious quants have an investment thesis they believe in, and the backtest serves to examine how that thesis has performed in different periods rather than the basis for discovering it.Cliff Asness: A Brief and Biased Survey of Quantitative Investing
- Moving average parameters (e.g., 100 vs 200 vs 252) matter less than adapting the parameter to match the market's actual trend speed, and over-optimizing parameters through backtesting produces results unlikely to hold out-of-sample.The Art of Trading Currencies, the World's Largest Market (w/ Dave Floyd and Brent Donnelly)
- Backtesting effective altruism—asking what EA-style reasoning would have recommended at past moments in history—is a useful way to stress-test whether the movement's judgments are reliable rather than driven by hindsight.Fin Moorhouse - Longtermism, Space, & Entrepreneurship
- GA trained an AI 'IC robot' on 45 years of deal data as a sixth investment committee member who votes on every deal; backtesting shows it is much better than humans at the past, but it has only about three years of concurrent data, so it will need four or five more years to be proven against live decisions.Inside General Atlantic: How a $100B Growth Equity Firm Invests
- AIs can train on prediction tasks built from history, such as deriving general relativity from a corpus ending before 1700 or predicting the Cuban Missile Crisis from newspapers through 1962, developing scientific and political judgment beyond the shrewdest human forecasters.Dwarkesh Patel Podcast - The avalanche that hit math is coming for AI development
- AI software like OneConcern's can estimate which homes were damaged in a hurricane by aggregating thousands of building and occupancy data points and back-testing against past storms, helping first responders act faster when 911 systems are overloaded.The Future of Venture Capital
- The firm's historical data gave it more extensive pricing information than rivals, which let it judge when trends would continue or fade, and the host notes this was a recurring theme in the book that human nature doesn't change.#108 Jim Simons (Money Printer)
- Backtesting an HFT strategy is difficult enough that a realistic simulator essentially requires building the whole exchange yourself.Doug Colkitt - The Evolution of Markets - [Invest Like the Best, EP. 255]