causal
AI Skeptics Missed Key Scaling Results
People writing about AI around 2020 missed scaling because they hadn't appreciated prior scaling results (e.g. AlphaZero discovered partly via Bayesian hyperparameter optimization that revealed tree search could be reduced, and Baidu's 2017 scaling-laws paper that showed scaling laws persist), and because they shared the error of believing algorithms matter more than compute.
causalpending
Speaker
GwernEvidence Quote
“It should have been the most important paper of the year, but a lot of people just did not prioritize it. It didn't have any immediate implication, and so it sort of got forgotten.”
Source
Gwern — Anonymous writer who predicted AI trajectory on $12K/year salary— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:28:51 AM
Your notes
Loading notes...