Out of 744 billion total parameters in GLM 5.2, only 40 billion parameters are actually active per token, which is roughly 5% of the total model size.

factualpending

Speaker

Andras

Evidence Quote

“Out of 744 billion total parameters, only 40 billion are actually active per token. And that's roughly 5%.”

Source

This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)— Better Stack
Created: 8/13/2026, 9:49:20 AM

Your notes

Loading notes...