causal

Inductive Bias Closes the Human-LLM Data Gap

The big difference between human minds and current large language models is inductive bias: a human child learns language from about five years of exposure, whereas the data used to train an LLM is equivalent to between 5,000 and 50,000 years of continuous speech; the thing that makes up that orders-of-magnitude gap is the inductive bias—prior distributions broadly construed—that humans bring.

causalpending

Speaker

Tom Griffiths

Evidence Quote

“the thing that makes up that gap is inductive bias. It's the sort of the thing that comes from our prior distributions broadly construed, as human beings, that allows us to close that gap.”

Source

343 | Tom Griffiths on The Laws of Thought— Sean Carroll's Mindscape
Created: 6/13/2026, 12:12:58 AM

Your notes

Loading notes...