causal
The Bitter Lesson of AI Research
Over the recent history of AI, attempts to improve models by hard-coding human knowledge repeatedly underperform simply letting connectionist models learn from data bottom-up—a pattern Rich Sutton called the 'Bitter Lesson'—which holds across computer vision and language, where models induce grammar without any Chomskian innate universal grammar.
causalpending
Speaker
Raphael MilliereEvidence Quote
“it seems that in virtually every domain of artificial intelligence research it is more effective to let connectionist models... learn from data, learn empirically from the bottom up than it is to try to distill human knowledge into a neatly interpretable set of symbolic rules”
Created: 6/13/2026, 12:19:51 AM
Your notes
Loading notes...