causal

Catch-up speed reveals data as progress driver

Open models lag closed frontier models by only about 4 months, and this fast catch-up suggests data is the real driver of progress because data can be distilled from public APIs whereas hyperparameters, training tricks, and architectural micro-optimizations cannot be easily copied; if those were the main drivers, catching up would be slower.

causalpending

Speaker

Dwarkesh Patel

Evidence Quote

“data can be easily distilled from public APIs, whereas hyper-parameters and training tricks and architectural micro-optimizations cannot”

Source

Dwarkesh Patel Podcast - The data black hole at the center of AI— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:11:50 AM

Your notes

Loading notes...