factual
Peak GPU utilization limited by power and thermals
Large-dimension matrix multiplies run at 70 to 80 percent of peak utilization, limited by power rather than software, and Nvidia's quoted peak flops is optimistic because power throttling and thermals prevent hitting it.
factualpending
Speaker
Neil MovvaEvidence Quote
“The way Nvidia quotes peak flops is a little optimistic — you never hit that because of power throttling.”
Created: 11/17/2026, 6:43:49 AM
Your notes
Loading notes...