causal

AI Skeptics Missed Key Scaling Results

People writing about AI around 2020 missed scaling because they hadn't appreciated prior scaling results (e.g. AlphaZero discovered partly via Bayesian hyperparameter optimization that revealed tree search could be reduced, and Baidu's 2017 scaling-laws paper that showed scaling laws persist), and because they shared the error of believing algorithms matter more than compute.

causalpending

Speaker

Gwern

Evidence Quote

“It should have been the most important paper of the year, but a lot of people just did not prioritize it. It didn't have any immediate implication, and so it sort of got forgotten.”

Source

Gwern — Anonymous writer who predicted AI trajectory on $12K/year salary— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:28:51 AM

Your notes

Loading notes...