HBM (High Bandwidth Memory)
Advanced memory technology that provides much higher bandwidth than traditional DRAM, critical for GPU performance in machine learning workloads where data movement is a bottleneck.
As defined in Ep17. Welcome Jensen Huang | BG2 w/ Bill Gurley & Brad Gerstner
Other definitions
Memory embedded directly within chip packages (rather than external) that allows data to move between processor and memory much faster, reducing latency that constrains AI training speed
AI and Quantum Computing: Glimpsing the Near Future | World Science Festival
Where it comes up · 3
- The Geopolitics of AI Infrastructure - Dylan Patel, SemiAnalysis2 claims
- Ep17. Welcome Jensen Huang | BG2 w/ Bill Gurley & Brad Gerstner1 claim
- AI and Quantum Computing: Glimpsing the Near Future | World Science Festival1 claim
Most important claims · 4 of 4Search all claims for “HBM (High Bandwidth Memory)” →
- Nvidia achieved a marginal cost reduction in computing of 100,000x over the course of 10 years, with Moore's Law alone accounting for about 100x, through accelerated computing, tensor cores, HBM, NVLink, new numerical precisions, and new architectures.Ep17. Welcome Jensen Huang | BG2 w/ Bill Gurley & Brad Gerstner
- Current AI training models are datacentric and suffer from memory bottlenecks where the chip is idle waiting for data; high bandwidth memory (HBM) embedded in chip packages solves this, and the next generation of chips may be 10x faster through these techniques.AI and Quantum Computing: Glimpsing the Near Future | World Science Festival
- Despite US sanctions on Huawei and China, Huawei accessed TSMC manufacturing through Sofco, a cryptocurrency mining company that posed as unaffiliated, enabling production of approximately 2.9 million Ascend chips, demonstrating the ineffectiveness of export controls.The Geopolitics of AI Infrastructure - Dylan Patel, SemiAnalysis
- Huawei has accumulated approximately 13 million HBM stacks through the Samsung-Coasia-Faraday supply chain workaround and continues to receive additional shipments.The Geopolitics of AI Infrastructure - Dylan Patel, SemiAnalysis