causal
LLMs Prove Chomsky's Data Requirement
Large language models illustrate exactly how much data is needed to solve Chomsky's learning problem: if LLMs have learned something like human language, this proves Chomsky's point that learning language requires enormous data—a child cannot figure out language structure in five years, and it takes something like 5,000 to 50,000 years of data to do it well; the difference is made up by inductive bias from evolution and broader world experience.
causalpending
Speaker
Tom GriffithsEvidence Quote
“you can think about that as a proof of the point that Chomsky was making, that you're going to need lots and lots and lots of data to learn something like human language.”
Created: 6/13/2026, 12:12:58 AM
Your notes
Loading notes...