causal
AI Gains Come From More Data and Compute
The main way AIs have improved is by adding more and better data and scaling the compute used to generate that data, with RL being the dominant method, which works as a kind of synthetic data generation against a verifier.
causalpending
Speaker
Dwarkesh PatelEvidence Quote
“You can think of RL as a kind of synthetic data generation - you dump a lot of compute against a verifier in order to find the “good” data.”
Created: 11/17/2026, 6:11:50 AM
Your notes
Loading notes...