Sheela
Sheela
Home
Add
Questions
Thinkers
Claims
People
Concepts
Jargon
Sources
Health
Predictions
Collections
Domain Landscape
Contribute
Review
Dedup
Topic requests
Settings
Help

← Jargon

Jargoncomputer science· 3 claims· 1 episode

disk I/O

Input/Output operations involving disk storage; reading from or writing to a disk, which is typically the slowest operation in a modern computer relative to RAM and CPU operations

As defined in This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)


Where it comes up · 1
  • This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)3 claims

Most important claims · 3 of 3Search all claims for “disk I/O” →
  • The single biggest constraint on running large frontier models on normal hardware is not GPU compute power but RAM availability—specifically, how much of the model can remain in RAM to avoid constant disk I/O.This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)
  • On the workstation test with 64GB RAM, the profiling showed disk waiting dropped to about 48% of total time (half the MacBook's 80%), while actual compute time increased substantially, demonstrating that more RAM reduces disk I/O dependency.This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)
  • On the MacBook test, the profiling breakdown showed that of 158 seconds total time for one generation, approximately 145 seconds (over 80%) was spent waiting for disk I/O, while only 7 seconds was actual computation.This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)