factual

Model rollouts dwarf human practice in volume

Models must grind far more numerous and harder tasks than humans, since GRPO generates hundreds to thousands of rollouts per task whereas a human student might practice a textbook problem once or twice, making the process look like a Frankenstein's monster of grafted examples.

factualpending

Speaker

Dwarkesh Patel

Evidence Quote

“GRPO has the model generate hundreds to thousands of rollouts per task”

Source

Dwarkesh Patel Podcast - The data black hole at the center of AI— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:11:50 AM

Your notes

Loading notes...