causal

Cable density physically constrains scale-up domain size

The reason racks use a hierarchy of switches rather than one giant scale-up switch is cabling congestion: doubling GPUs per rack requires literally twice the cable density, and physical constraints—connector and backplane density, cable bend radius, rack weight, power, and cooling—are pushed to extreme limits, so cable space, not memory, bounds scale-up domain growth.

causalpending

Speaker

Reiner Pope

Evidence Quote

“if I want to double the number of GPUs in a rack, I need to run literally twice the density of cables”

Source

Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:34:09 AM

Your notes

Loading notes...