← Jargon

Jargonmachine learning· 39 claims· 15 episodes

KV cache

The stored key and value tensors from previous tokens that a transformer reuses during generation to avoid recomputation; its size grows with context length and is a major memory cost.

As defined in Ai Sota #2026


Where it comes up · 15

and 7 more


Most important claims · 10 of 39Search all claims for “KV cache” →