causal
Catch-up speed reveals data as progress driver
Open models lag closed frontier models by only about 4 months, and this fast catch-up suggests data is the real driver of progress because data can be distilled from public APIs whereas hyperparameters, training tricks, and architectural micro-optimizations cannot be easily copied; if those were the main drivers, catching up would be slower.
causalpending
Speaker
Dwarkesh PatelEvidence Quote
“data can be easily distilled from public APIs, whereas hyper-parameters and training tricks and architectural micro-optimizations cannot”
Created: 11/17/2026, 6:11:50 AM
Your notes
Loading notes...