factual
Rack-scale programming replaces single-GPU optimization
The unit of optimization is now the whole rack or cluster rather than one GPU, since Nvidia ships systems like NVL72 as prescribed racks of 72 units, and whoever programs rack-scale compute most efficiently will win on latency and throughput.
factualpending
Speaker
Neil MovvaEvidence Quote
“it's an open race to figure out who can program the whole rack-scale computer as efficiently as possible.”
Created: 11/17/2026, 6:43:49 AM
Your notes
Loading notes...