CUDA
Compute Unified Device Architecture—NVIDIA's free (but proprietary) software platform that lets programmers run general scientific and AI computation on its GPUs, creating long-term lock-in to NVIDIA hardware.
As defined in The Man Who Built NVIDIA (with Stephen Witt)
Other definitions
Nvidia's parallel computing platform and programming model that enables developers to use Nvidia GPUs for general-purpose computing; the industry standard for GPU-accelerated computing that provides APIs, libraries, and tools for developers.
Ep17. Welcome Jensen Huang | BG2 w/ Bill Gurley & Brad Gerstner
Where it comes up · 27
- #403: How Jensen Works6 claims
- Dwarkesh Patel Podcast - Jensen Huang – TPU competition, why we should sell chips to China, & Nvidia’s supply chain moat5 claims
- #376: Jensen Huang: Founder of Nvidia4 claims
- Gavin Baker - AI, Semiconductors, and the Robotic Frontier - [Invest Like the Best, EP.385]4 claims
- Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383]4 claims
- Lex Fridman Podcast #494 - Jensen Huang4 claims
- DeepSeek's Invisible Founder Just Talked for 4 Hours. It Leaked.3 claims
- Intel: Cyclical Recovery or Secular Demise?3 claims
and 19 more
Most important claims · 10 of 61Search all claims for “CUDA” →
- Jensen recognized that general-purpose GPU computing could expand NVIDIA's market beyond graphics, so he built CUDA, a programming model that lets scientists and engineers use GPU computing power, to generate demand by making GPUs easier to program.#376: Jensen Huang: Founder of Nvidia
- NVIDIA educated the market for CUDA by giving universities CUDA-capable machines in exchange for teaching classes, having chief scientist David Kirk give over a hundred talks, and writing a textbook that sold tens of thousands of copies.#376: Jensen Huang: Founder of Nvidia
- Install base is the single most important property of a computing architecture; this is why the inelegant x86 architecture survived and dominated while beautifully designed RISC architectures largely failed, and why NVIDIA deliberately put CUDA on every GeForce GPU to cultivate an install base for developers.Lex Fridman Podcast #494 - Jensen Huang
- Huang saw that researchers using GPUs for non-graphical computing signaled a huge opportunity, so he hired the researcher who coined GPGPU and pushed CUDA to make GPUs easy to program, expanding the market beyond graphics.#403: How Jensen Works
- Because AI model architectures change about every six months while hardware and system architectures change about every three years, NVIDIA must anticipate two to three years ahead by doing its own research, working with every AI company in the world, and keeping CUDA flexible enough to adapt—exemplified by building NVLink 72 to fit a 4-10 trillion parameter mixture-of-experts model in one computing domain.Lex Fridman Podcast #494 - Jensen Huang
- Nvidia's CUDA software layer gave programmers low-level access to GPUs, and when developers used it for AI in the 2000s, it became the default AI GPU platform, a software advantage AMD has struggled to match.AMD: How Chips Are Changing
- NVIDIA's push to make CUDA a foundational technology took four years and cut gross margin from 45% to 35%, and during the 2007-2008 period NVIDIA's stock fell more than 80% as the financial crisis destroyed consumer demand.#376: Jensen Huang: Founder of Nvidia
- NVIDIA's dominance is protected by CUDA, which has been optimized for more than 15 years, and new chip challengers face very high barriers because chip failures in large-scale training only surface at multi-thousand node scale, so simulation and small tests cannot confirm a chip works.Sarah Guo - The Power of Conviction - [Invest Like the Best, EP.383]
- Anytime you make something easier for people to do, the market expands, which is why Jensen made GPUs easier to program via CUDA to bring general computing into every corner of tech.#403: How Jensen Works
- Around 2012, fringe researchers used two ~$1,000 NVIDIA GPUs and CUDA to jerry-rig a supercomputer that simulated brain neurons, producing AlexNet—suddenly computers could identify images with unprecedented accuracy on cheap commodity hardware, proving the missing ingredient for neural nets was firepower and inaugurating NVIDIA's AI phase.The Man Who Built NVIDIA (with Stephen Witt)