causal
Inductive Bias Closes the Human-LLM Data Gap
The big difference between human minds and current large language models is inductive bias: a human child learns language from about five years of exposure, whereas the data used to train an LLM is equivalent to between 5,000 and 50,000 years of continuous speech; the thing that makes up that orders-of-magnitude gap is the inductive bias—prior distributions broadly construed—that humans bring.
causalpending
Speaker
Tom GriffithsEvidence Quote
“the thing that makes up that gap is inductive bias. It's the sort of the thing that comes from our prior distributions broadly construed, as human beings, that allows us to close that gap.”
Created: 6/13/2026, 12:12:58 AM
Your notes
Loading notes...