DeepSeek V3 uses multi-head latent attention (MLA) which compresses key and value matrices into a latent representation and reconstructs them only when needed, reducing KV cache size by 93.3% and boosting maximum generation throughput to 5.76x compared to traditional approaches

factualpending

Speaker

Unidentified Speaker — The Engineering Unlocks Behind DeepSeek | YC Decoded [4Tmn-XP93m4]

Evidence Quote

“V3 makes use of multi head latent attention or MLA which deep seek first revealed with its V2 paper which was published in May 2024 MLA is a solution designed to tackle KV cat storage limitation one of the biggest sources of bam overhead in large models instead of storing full key and value matrices MLA manages to compress press them down into a latent representation reconstructing them only when needed this helped the B2 model reduce his KV cach size by 93.3% and boosted its maximum generation throughput to 5.76 times”

Source

The Engineering Unlocks Behind DeepSeek | YC Decoded— Y Combinator
Created: 8/11/2026, 6:44:59 AM

Your notes

Loading notes...