← Jargon

Jargonmachine learning· 11 claims· 3 episodes

memory bandwidth

The rate at which data can be read from or written to a GPU's memory; especially important for serving reasoning models with large KV caches.

As defined in Deepseek Dylan Patel Nathan Lambert


Where it comes up · 3

Most important claims · 10 of 11Search all claims for “memory bandwidth” →