causal
Gemini 200K price step aligns with compute/memory crossover
Gemini 3.1 charging 50% more above 200K tokens likely reflects a two-tier pricing structure aligned with the crossover point where memory-fetch time overtakes the constant compute time as a function of context length; solving the balance with ~100B active params and ~2kbytes/token reproduces this, since labs price close to cost to avoid being undercut.
causalpending
Speaker
Reiner PopeEvidence Quote
“given that the bump is at 200k, it probably means that this is somewhat aligned with this crossover point... you are incentivized to price close to your costs because otherwise someone could scoop you.”
Source
Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:34:09 AM
Your notes
Loading notes...