Sheela
Sheela
Home
Add
Questions
Thinkers
Claims
People
Concepts
Jargon
Sources
Health
Predictions
Collections
Domain Landscape
Contribute
Review
Dedup
Topic requests
Settings
Help

← Jargon

Jargonmachine learning· 1 claim· 1 episode

Bayesian optimization

A method for efficiently searching over hyperparameters by building a probabilistic model of performance.

As defined in Gwern — Anonymous writer who predicted AI trajectory on $12K/year salary


Where it comes up · 1
  • Gwern — Anonymous writer who predicted AI trajectory on $12K/year salary1 claim

Most important claims · 1 of 1Search all claims for “Bayesian optimization” →
  • People writing about AI around 2020 missed scaling because they hadn't appreciated prior scaling results (e.g. AlphaZero discovered partly via Bayesian hyperparameter optimization that revealed tree search could be reduced, and Baidu's 2017 scaling-laws paper that showed scaling laws persist), and because they shared the error of believing algorithms matter more than compute.Gwern — Anonymous writer who predicted AI trajectory on $12K/year salary