At fp8 precision, AI labs typically achieve only around 35% model FLOPs utilization (MFU), meaning GPUs are utilized at peak potential only about one-third of the time while the rest of the time GPUs wait for data movement between caches or other GPUs
factualpending
Evidence Quote
“at fp8 it is typical to only see around 35% model flops utilization or mfu meaning gpus are only being utilized at Peak potential about a third of the time the rest of the time these gpus are waiting for data to be moved either between caches or other gpus”
Created: 8/11/2026, 6:44:59 AM
Your notes
Loading notes...