factual

FLOPs-to-bandwidth ratio stable across GPU generations

The dimensionless ratio of compute throughput to memory bandwidth (~300) has remained reasonably stable from A100 to H100 to B100 because, although FLOPs increased substantially across generations, memory bandwidth also increased substantially.

factualpending

Speaker

Reiner Pope

Evidence Quote

“From A100 to H100 to B100, the FLOPs have increased substantially, the memory bandwidth has also increased substantially, and it has remained reasonably stable.”

Source

Dwarkesh Patel Podcast - Reiner Pope – The math behind how LLMs are trained and served— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:34:09 AM

Your notes

Loading notes...