The 14B distilled variant requires around 8.5 GB of VRAM and runs on an RTX 4070 12GB; the 32B at Q4 quantization requires roughly 17.5 GB and runs on an RTX 4090—hardware requirements are accessible consumer-grade GPUs.
factualpending
Evidence Quote
“Per LeLm Hardware's hardware guide, the 14B distilled variant needs around 8.5 GB of VRAM. An RTX 4070 12GB handles it.”
Created: 8/12/2026, 2:31:09 AM
Your notes
Loading notes...