causal

AI Gains Come From More Data and Compute

The main way AIs have improved is by adding more and better data and scaling the compute used to generate that data, with RL being the dominant method, which works as a kind of synthetic data generation against a verifier.

causalpending

Speaker

Dwarkesh Patel

Evidence Quote

“You can think of RL as a kind of synthetic data generation - you dump a lot of compute against a verifier in order to find the “good” data.”

Source

Dwarkesh Patel Podcast - The data black hole at the center of AI— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:11:50 AM

Your notes

Loading notes...