factual
Labs may use spinning disk for KV cache storage
The 1-hour cache pricing tier's implied drain time suggests the slowest KV cache storage tier may be spinning disk, which Pope finds shocking given it is such an old, unattractive technology that it takes about an hour to read its full capacity.
factualpending
Speaker
Reiner PopeEvidence Quote
“I think that probably indicates that the two tiers are flash and spinning disk. I’m kind of shocked to see spinning disk being used at all, because it’s such an old technology.”
Source
Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:34:09 AM
Your notes
Loading notes...