causal

The Bitter Lesson of AI Research

Over the recent history of AI, attempts to improve models by hard-coding human knowledge repeatedly underperform simply letting connectionist models learn from data bottom-up—a pattern Rich Sutton called the 'Bitter Lesson'—which holds across computer vision and language, where models induce grammar without any Chomskian innate universal grammar.

causalpending

Speaker

Raphael Milliere

Evidence Quote

“it seems that in virtually every domain of artificial intelligence research it is more effective to let connectionist models... learn from data, learn empirically from the bottom up than it is to try to distill human knowledge into a neatly interpretable set of symbolic rules”

Source

230 | Raphaël Millière on How Artificial Intelligence Thinks— Sean Carroll's Mindscape
Created: 6/13/2026, 12:19:51 AM

Your notes

Loading notes...