On the MacBook test, this was a cold start where nothing was cached yet, forcing the system to fetch every piece of the model from the external drive from scratch.

factualpending

Speaker

Andras

Evidence Quote

“this was a cold start. The first question, nothing was cached yet, so it had to go fetch every piece of the model off that drive from scratch.”

Source

This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)— Better Stack
Created: 8/13/2026, 9:49:20 AM

Your notes

Loading notes...