When the model needs a specific expert for a token, Colibri streams just that expert off disk, uses it, and caches it, rather than loading the entire model into memory.

factualpending

Speaker

Andras

Evidence Quote

“When the model needs a specific expert for a token, Colibri streams just that expert off disk, uses it, and caches it.”

Source

This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)— Better Stack
Created: 8/13/2026, 9:49:20 AM

Your notes

Loading notes...