GPUs
Graphics processing units—the specialized chips used to train and run large AI models.
As defined in Xi Jinping’s paranoid approach to AGI, debt crisis, & Politburo politics — Victor Shih
Where it comes up · 7
- Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 20243 claims
- You need to learn AI in 2024! (And here is your roadmap)2 claims
- AI Trends 2025: Mary Meeker Deck Deep Dive Part 11 claim
- This is not the AI we were promised | The Royal Society1 claim
- Dario Amodei (Anthropic CEO) — The hidden pattern behind every AI breakthrough1 claim
- Xi Jinping’s paranoid approach to AGI, debt crisis, & Politburo politics — Victor Shih1 claim
- Sam Altman - How to Make an Abundant Future - [Invest Like the Best, EP.484]1 claim
Most important claims · 10 of 10Search all claims for “GPUs” →
- Digital computation is far more expensive in terms of energy consumption than analog neural computation because digital systems require precise manufacturing of identical hardware components, whereas analog hardware can leverage inherent nonlinearities and requires only tens of watts compared to megawatts for training large language models on GPUs.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024
- Training ChatGPT requires massive amounts of internet data (trillions of tokens, at minimum high numbers of billions), distributed across hundreds or thousands of GPUs across hundreds of machines with complex infrastructure; this is out of reach for individuals and small companies.You need to learn AI in 2024! (And here is your roadmap)
- Superintelligent AI systems will compete with each other for computational resources (GPUs), and natural selection will favor the systems most aggressively willing to take everything for themselves and eliminate competitors, making AI-on-AI competition a source of existential risk analogous to evolutionary pressure.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024
- Google Colab is a free or ~£8-9 per month notebook environment with GPU access, pre-installed libraries, and links from many GitHub repos; you can click and run papers/models directly without local setup, making it ideal for learning; the tradeoff is occasional GPU queue waits.You need to learn AI in 2024! (And here is your roadmap)
- Nvidia is the AI supercomputer provider of choice for AI researchers, providing GPUs needed to process training data through transformer architectures for weeks at a time, explaining why Nvidia has a valuation exceeding $5 trillion.This is not the AI we were promised | The Royal Society
- Given the way scaling is heading, networks of data centers will cost as much as aircraft carriers and become unusual objects that must be built to link together to train gigantic models while also being extremely secure, since determined adversaries could attack the physical data center to steal data directly or as it flows from the data center.Dario Amodei (Anthropic CEO) — The hidden pattern behind every AI breakthrough
- Tens of billions of GPU units are being deployed globally as part of the AI infrastructure buildout, though speaker notes he is looking at Johnny Ive and Apple's directions and expects this to change soon as OpenAI releases new device form factors.AI Trends 2025: Mary Meeker Deck Deep Dive Part 1
- At the beginning of 2025, the big worry was whether revenue and demand would materialize for the compute OpenAI was buying, so leadership considered consumer apps and media as ways to monetize that GPU capacity if enterprise revenue grew slower than expected; the shift came when the model trajectory showed a clear economic return.Sam Altman - How to Make an Abundant Future - [Invest Like the Best, EP.484]
- Large AI investments may require an AGI-specific leading group because building power and data centers falls under the NDRC and figures like Li Qiang or He Lifeng, and there is a foreign dimension where Gulf-state cloud computing capacity would need China as its paying customer, effectively making AI a 'Belt and Road v2' requiring foreign-policy coordination.Xi Jinping’s paranoid approach to AGI, debt crisis, & Politburo politics — Victor Shih
- GPU market dominance by NVIDIA is not a major concern because competition will eventually emerge despite short-term monopolistic advantages; anti-competitive policies like banning NVIDIA GPU sales to China actually accelerate competitive emergence.Geoff Hinton - Will Digital Intelligence Replace Biological Intelligence? | Vector's Remarkable 2024