factual

Labs may use spinning disk for KV cache storage

The 1-hour cache pricing tier's implied drain time suggests the slowest KV cache storage tier may be spinning disk, which Pope finds shocking given it is such an old, unattractive technology that it takes about an hour to read its full capacity.

factualpending

Speaker

Reiner Pope

Evidence Quote

“I think that probably indicates that the two tiers are flash and spinning disk. I’m kind of shocked to see spinning disk being used at all, because it’s such an old technology.”

Source

Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:34:09 AM

Your notes

Loading notes...