causal

LLMs Prove Chomsky's Data Requirement

Large language models illustrate exactly how much data is needed to solve Chomsky's learning problem: if LLMs have learned something like human language, this proves Chomsky's point that learning language requires enormous data—a child cannot figure out language structure in five years, and it takes something like 5,000 to 50,000 years of data to do it well; the difference is made up by inductive bias from evolution and broader world experience.

causalpending

Speaker

Tom Griffiths

Evidence Quote

“you can think about that as a proof of the point that Chomsky was making, that you're going to need lots and lots and lots of data to learn something like human language.”

Source

343 | Tom Griffiths on The Laws of Thought— Sean Carroll's Mindscape
Created: 6/13/2026, 12:12:58 AM

Your notes

Loading notes...