factual

Peak GPU utilization limited by power and thermals

Large-dimension matrix multiplies run at 70 to 80 percent of peak utilization, limited by power rather than software, and Nvidia's quoted peak flops is optimistic because power throttling and thermals prevent hitting it.

factualpending

Speaker

Neil Movva

Evidence Quote

“The way Nvidia quotes peak flops is a little optimistic — you never hit that because of power throttling.”

Source

Neil Movva - Making AI 10x Cheaper - [Invest Like the Best, EP.488]— Invest Like the Best
Created: 11/17/2026, 6:43:49 AM

Your notes

Loading notes...