definition
RL as synthetic data generation via verifiers
Reinforcement learning can be understood as synthetic data generation: a large amount of compute is applied against a verifier to find good outputs, and the model is then trained to predict those correct rollouts much as it predicts next words in internet text.
definitionpending
Speaker
Dwarkesh PatelEvidence Quote
“You can think of RL as a kind of synthetic data generation”
Created: 11/17/2026, 6:11:50 AM
Your notes
Loading notes...