factual

Scaling Works But We Don't Know Why

The fact that throwing large amounts of compute at a wide enough distribution of data produces intelligence is almost entirely an empirical observation; there is no satisfying theoretical explanation, though analogies to power-law/long-tail correlations in physics suggest each order of magnitude captures more of the data distribution, yet why this scales so smoothly with parameters and data remains unknown.

factualpending

Speaker

Dario Amodei (Anthropic CEO)

Evidence Quote

“What's not clear at all is why does it scale so smoothly with parameters? Why does it scale so smoothly with the amount of data?”

Source

Dario Amodei (Anthropic CEO) — The hidden pattern behind every AI breakthrough— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:25:28 AM

Your notes

Loading notes...