disk I/O
Input/Output operations involving disk storage; reading from or writing to a disk, which is typically the slowest operation in a modern computer relative to RAM and CPU operations
As defined in This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)
Where it comes up · 1
Most important claims · 3 of 3Search all claims for “disk I/O” →
- The single biggest constraint on running large frontier models on normal hardware is not GPU compute power but RAM availability—specifically, how much of the model can remain in RAM to avoid constant disk I/O.This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)
- On the workstation test with 64GB RAM, the profiling showed disk waiting dropped to about 48% of total time (half the MacBook's 80%), while actual compute time increased substantially, demonstrating that more RAM reduces disk I/O dependency.This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)
- On the MacBook test, the profiling breakdown showed that of 158 seconds total time for one generation, approximately 145 seconds (over 80%) was spent waiting for disk I/O, while only 7 seconds was actual computation.This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)