causal

Smaller Models Tighten the RSI Loop

As pretraining improves, smaller models can match larger ones while training faster and cheaper, which speeds experiments and lets labs train models at a scale where thousands of experiments run daily, so small-scale results need not be bet on bigger models.

causalpending

Speaker

Dwarkesh Patel

Evidence Quote

“Third, because smaller models train faster, this tightens the RSI loop itself. ... you won't have to bet that small-scale results will hold up in bigger models.”

Source

Dwarkesh Patel Podcast - The avalanche that hit math is coming for AI development— Dwarkesh Patel Podcast
Created: 11/17/2026, 6:27:26 AM

Your notes

Loading notes...