factual
FLOPs-to-bandwidth ratio stable across GPU generations
The dimensionless ratio of compute throughput to memory bandwidth (~300) has remained reasonably stable from A100 to H100 to B100 because, although FLOPs increased substantially across generations, memory bandwidth also increased substantially.
factualpending
Speaker
Reiner PopeEvidence Quote
“From A100 to H100 to B100, the FLOPs have increased substantially, the memory bandwidth has also increased substantially, and it has remained reasonably stable.”
Source
Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:34:09 AM
Your notes
Loading notes...