Grace Blackwell with NVLink was architected specifically to optimize for inference with low time-to-first-token, requiring infinite bandwidth and infinite compute simultaneously to achieve millisecond response times with rich context.

factualpending

Speaker

Jensen Huang

Evidence Quote

“optimize for this time to First token...infinite amount of bandwidth infinite amount of flops...Grace Blackwell MV link”

Source

Ep17. Welcome Jensen Huang | BG2 w/ Bill Gurley & Brad Gerstner— Bg2 Pod
Created: 8/10/2026, 3:55:45 PM

Your notes

Loading notes...