factual
Cost minimized where training and inference costs equalize
As a heuristic, when minimizing a total cost that is the sum of an increasing and a decreasing term (like training cost versus inference cost), the minimum tends to occur where the two costs are equalized—a property that holds for many power-law and exponential curve pairs—so optimal model design should roughly equalize pre-training, RL, and inference compute costs.
factualpending
Speaker
Reiner PopeEvidence Quote
“For many curves, the minimum tends to be where the costs are equalized. That’s something of a heuristic claim, but there are many examples where it’s true.”
Source
Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:34:09 AM
Your notes
Loading notes...