The dense components of GLM 5.2 are only about 17 billion parameters, or under 10 gigabytes at int4 quantization, and remain resident in RAM at all times.

factualpending

Speaker

Andras

Evidence Quote

“The model's dense components, the parts used on every token, are actually small, about 17 billion parameters, and that's under 10 gigabytes at integer four quantization.”

Source

This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)— Better Stack
Created: 8/13/2026, 9:49:20 AM

Your notes

Loading notes...