factual

Cost minimized where training and inference costs equalize

As a heuristic, when minimizing a total cost that is the sum of an increasing and a decreasing term (like training cost versus inference cost), the minimum tends to occur where the two costs are equalized—a property that holds for many power-law and exponential curve pairs—so optimal model design should roughly equalize pre-training, RL, and inference compute costs.

factualpending

Speaker

Reiner Pope

Evidence Quote

“For many curves, the minimum tends to be where the costs are equalized. That’s something of a heuristic claim, but there are many examples where it’s true.”

Source

Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:34:09 AM

Your notes

Loading notes...