GPU
Graphics processing unit; specialized chips, here used in large quantities ('warehouses') to train and run large AI models.
As defined in cwt_paul-graham
Where it comes up · 50
- This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)7 claims
- The AI Reset Is Here: Search, Jobs, and Everything Else w/ Anish Acharya, Dave Blundin, Salim Ismail6 claims
- @Asianometry & Dylan Patel — How the semiconductor industry actually works6 claims
- Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 20245 claims
- Auto1: EU-sed Car Marketplace4 claims
- Jeremiah Lowin: Explaining the New AI Paradigm - [Invest Like the Best, EP.307]4 claims
- Semiconductors: Everything You Wanted to Know4 claims
- AI Trends 2025: Mary Meeker Deck Deep Dive Part 13 claims
and 42 more
Most important claims · 10 of 104Search all claims for “GPU” →
- The gaming revolution, including Quake, Duke Nukem, and Unreal Tournament, drove the development of GPUs, without which modern AI could not have been built, so game-playing in the 1990s helped make the AI revolution possible.Lex Fridman Podcast #501 - DHH
- The core idea of modern machine learning, taking an input, transforming it through a latent representation, and outputting it, has not dramatically changed in roughly 15 to 20 years; the progress has come from making models bigger and from refinements and enhancements of the architecture.Jeremiah Lowin: Explaining the New AI Paradigm - [Invest Like the Best, EP.307]
- It is not a coincidence that data, transformers, and GPUs arrived together: shrinking transistors made personal computers economical, which created the internet and thus mass data, while the same transistor progress drove GPUs through gaming before Nvidia repurposed them for general computation — all dimensions of progress are intertwined and you don't get to pick which improve.Ilya Sutskever (OpenAI Chief Scientist) — Why next-token prediction could surpass human intelligence
- Around 2012, fringe researchers used two ~$1,000 NVIDIA GPUs and CUDA to jerry-rig a supercomputer that simulated brain neurons, producing AlexNet—suddenly computers could identify images with unprecedented accuracy on cheap commodity hardware, proving the missing ingredient for neural nets was firepower and inaugurating NVIDIA's AI phase.The Man Who Built NVIDIA (with Stephen Witt)
- Solana runs transactions natively on modern NVIDIA graphics cards with thousands of cores, so a card with about 4,000 cores can execute thousands of jobs in parallel, versus the handful of cores a laptop uses for serial code.Solana: Faster, Cheaper, More Scalable
- GPU mining hardware can be redeployed to rendering or AI workloads if crypto markets change, reducing hardware investment risk, whereas ASIC hardware only mines one coin and can become nearly worthless.Full Tilt Investing
- Data center power use has decreased 43% over 8 years while per-unit energy efficiency has improved 50,000x, and tokens per megawatt per year have scaled from 1.3 billion to 65 trillion, demonstrating dramatic improvements in compute efficiency that are underreported in energy consumption headlines.AI Trends 2025: Mary Meeker Deck Deep Dive Part 1
- Capital is not the binding constraint on any one iteration of generative AI: roughly 4,000 GPUs at about $40 million a year is a manageable cost for a well-funded company, and the true constraints are time, energy, intuition, and ingenuity, since research requires iterative bets that take about a month each.Jeremiah Lowin: Explaining the New AI Paradigm - [Invest Like the Best, EP.307]
- GLM 5.2 is a 744 billion parameter language model in the same size class as frontier models running in data centers, but Colibri enables it to run on consumer hardware.This Tiny Engine Runs Impossibly Big AI Models Locally! (colibrì)
- Nvidia strategically introduced CUDA software 15 years ago, which abstracted GPU programming complexity and enabled third-party developers to write GPU-accelerated code, creating a software ecosystem lock-in that competitors cannot replicateSemiconductors: Everything You Wanted to Know