causal
Cable density physically constrains scale-up domain size
The reason racks use a hierarchy of switches rather than one giant scale-up switch is cabling congestion: doubling GPUs per rack requires literally twice the cable density, and physical constraints—connector and backplane density, cable bend radius, rack weight, power, and cooling—are pushed to extreme limits, so cable space, not memory, bounds scale-up domain growth.
causalpending
Speaker
Reiner PopeEvidence Quote
“if I want to double the number of GPUs in a rack, I need to run literally twice the density of cables”
Source
Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:34:09 AM
Your notes
Loading notes...