forecast
The Bitter Lesson Holds While Scaling Laws Are Fundamental
If scaling laws are fundamental in deep learning, the Bitter Lesson will always apply because compute becomes more abundant—but even with abundant compute, the methods with a steeper scaling-law slope or better offset (getting 100x out of the same compute) will win, so leverage on compute still matters.
forecastpending
Speaker
Nathan LambertEvidence Quote
“the ones that get 100x out of it will win.”
Created: 6/13/2026, 3:24:41 AM
Your notes
Loading notes...