factual

Models Smaller Than Brain But Need More Data

There is an unexplained mystery in that models are maybe two to three orders of magnitude smaller than the human brain (by synapse count) while being trained on three to four more orders of magnitude of data (hundreds of billions to trillions of words versus the hundreds of millions a human sees by 18); this discrepancy breaks the brain analogy, suggesting either a missing factor or that other human modalities (like images) supply enormous data, but ultimately it doesn't matter for continued scaling.

factualpending

Speaker

Dario Amodei (Anthropic CEO)

Evidence Quote

“There's some way in which the analogy to the brain is not quite right or is breaking down or there's some missing factor.”

Source

Dario Amodei (Anthropic CEO) — The hidden pattern behind every AI breakthrough— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:25:28 AM

Your notes

Loading notes...