factual
Scaling Works But We Don't Know Why
The fact that throwing large amounts of compute at a wide enough distribution of data produces intelligence is almost entirely an empirical observation; there is no satisfying theoretical explanation, though analogies to power-law/long-tail correlations in physics suggest each order of magnitude captures more of the data distribution, yet why this scales so smoothly with parameters and data remains unknown.
factualpending
Speaker
Dario Amodei (Anthropic CEO)Evidence Quote
“What's not clear at all is why does it scale so smoothly with parameters? Why does it scale so smoothly with the amount of data?”
Source
Dario Amodei (Anthropic CEO) — The hidden pattern behind every AI breakthrough— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:25:28 AM
Your notes
Loading notes...