At fp8 precision, AI labs typically achieve only around 35% model FLOPs utilization (MFU), meaning GPUs are utilized at peak potential only about one-third of the time while the rest of the time GPUs wait for data movement between caches or other GPUs

factualpending

Speaker

Unidentified Speaker — The Engineering Unlocks Behind DeepSeek | YC Decoded [4Tmn-XP93m4]

Evidence Quote

“at fp8 it is typical to only see around 35% model flops utilization or mfu meaning gpus are only being utilized at Peak potential about a third of the time the rest of the time these gpus are waiting for data to be moved either between caches or other gpus”

Source

The Engineering Unlocks Behind DeepSeek | YC Decoded— Y Combinator
Created: 8/11/2026, 6:44:59 AM

Your notes

Loading notes...