factual
RL scales log-linearly just like pre-training
RL training exhibits the same scaling behavior as pre-training: how well a model does on tasks (e.g., math contests like AIME, but also a wide variety of RL tasks including code) is log-linear in how long it is trained, mirroring pre-training scaling laws.
factualpending
Speaker
Dario AmodeiEvidence Quote
“We see that as well, and it's not just math contests. It's a wide variety of RL tasks. We're seeing the same scaling in RL that we saw for pre-training.”
Source
Dwarkesh Patel Podcast - Dario Amodei — "We are near the end of the exponential"— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:32:46 AM
Your notes
Loading notes...