causal

Gemini 200K price step aligns with compute/memory crossover

Gemini 3.1 charging 50% more above 200K tokens likely reflects a two-tier pricing structure aligned with the crossover point where memory-fetch time overtakes the constant compute time as a function of context length; solving the balance with ~100B active params and ~2kbytes/token reproduces this, since labs price close to cost to avoid being undercut.

causalpending

Speaker

Reiner Pope

Evidence Quote

“given that the bump is at 200k, it probably means that this is somewhat aligned with this crossover point... you are incentivized to price close to your costs because otherwise someone could scoop you.”

Source

Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:34:09 AM

Your notes

Loading notes...