factual
Models Smaller Than Brain But Need More Data
There is an unexplained mystery in that models are maybe two to three orders of magnitude smaller than the human brain (by synapse count) while being trained on three to four more orders of magnitude of data (hundreds of billions to trillions of words versus the hundreds of millions a human sees by 18); this discrepancy breaks the brain analogy, suggesting either a missing factor or that other human modalities (like images) supply enormous data, but ultimately it doesn't matter for continued scaling.
factualpending
Speaker
Dario Amodei (Anthropic CEO)Evidence Quote
“There's some way in which the analogy to the brain is not quite right or is breaking down or there's some missing factor.”
Source
Dario Amodei (Anthropic CEO) — The hidden pattern behind every AI breakthrough— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:25:28 AM
Your notes
Loading notes...