Bayesian optimization
A method for efficiently searching over hyperparameters by building a probabilistic model of performance.
As defined in Gwern — Anonymous writer who predicted AI trajectory on $12K/year salary
Where it comes up · 1
Most important claims · 1 of 1Search all claims for “Bayesian optimization” →
- People writing about AI around 2020 missed scaling because they hadn't appreciated prior scaling results (e.g. AlphaZero discovered partly via Bayesian hyperparameter optimization that revealed tree search could be reduced, and Baidu's 2017 scaling-laws paper that showed scaling laws persist), and because they shared the error of believing algorithms matter more than compute.Gwern — Anonymous writer who predicted AI trajectory on $12K/year salary