factual

Human language exposure about 200 million tokens

A person who hears and sees about 2,000 words an hour sees roughly 200 million tokens from birth to adulthood, whereas frontier models are trained on somewhere between 10 and hundreds of trillions of tokens, a near-million-fold difference.

factualpending

Speaker

Dwarkesh Patel

Evidence Quote

“they’ll see ~200 millions tokens. By contrast, frontier models are trained on somewhere between 10s to 100s of trillions of tokens.”

Source

Dwarkesh Patel Podcast - The data black hole at the center of AI— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:11:50 AM

Your notes

Loading notes...