Nvidia's moat in inference will be greater than in training because Nvidia-trained models are architecturally built for Nvidia and will run on Nvidia, older Nvidia generations left behind from new training purchases become free inference infrastructure that remains Cuda compatible, and Nvidia continuously reinvents algorithms making older architectures better over time.

causalpending

Speaker

Jensen Huang

Evidence Quote

if you train well it is very likely you'll inference well if you built it on this architecture...when you're training new models...that gear is perfect for inference and so there's a trail of free gear

Source

Ep17. Welcome Jensen Huang | BG2 w/ Bill Gurley & Brad GerstnerBg2 Pod
Created: 8/10/2026, 3:55:45 PM

My Notes

Loading notes...