Grace Blackwell with NVLink was architected specifically to optimize for inference with low time-to-first-token, requiring infinite bandwidth and infinite compute simultaneously to achieve millisecond response times with rich context.
factualpending
Speaker
Jensen HuangEvidence Quote
“optimize for this time to First token...infinite amount of bandwidth infinite amount of flops...Grace Blackwell MV link”
Created: 8/10/2026, 3:55:45 PM
Your notes
Loading notes...