Whether LLMs are an instance of the bitter lesson is ambiguous: they use massive computation that scales up to the limits of Internet data, but they also embed enormous human knowledge, and they may be superseded by systems that learn from experience rather than from people—which would itself be another instance of the bitter lesson.
forecastpending
Speaker
Richard SuttonEvidence Quote
“I expect there to be systems that can learn from experience. Which could perform much better and be much more scalable. In which case, it will be another instance of the bitter lesson.”
Created: 6/18/2026, 1:59:29 PM
Your notes
Loading notes...