H800
An NVIDIA GPU that matched the H100 on FLOPS but had reduced interconnect bandwidth, designed for the China market and later banned by US export controls.
As defined in Deepseek Dylan Patel Nathan Lambert
Where it comes up · 2
- The AI Shortcut: How DeepSeek Cracked ChatGPT’s Secrets for Cheap6 claims
- Deepseek Dylan Patel Nathan Lambert1 claim
Most important claims · 7 of 7Search all claims for “H800” →
- Although DeepSeek publicly cited only 2,000 H800 GPUs for V3 pre-training and 10,000 A100s from 2021, SemiAnalysis research estimates they actually have closer to 50,000 GPUs split across the hedge fund, research, ablations, and training, far more than the cited training-run number.Deepseek Dylan Patel Nathan Lambert
- Due to US sanctions on China's advanced chips, top-tier GPUs like the H100 are no longer legally available to China, so Nvidia created a specialized chip for the Chinese market called the H800—a watered-down version with reduced clock speed but the same advanced architecture, performing at 60-77% of the H100's capability (1.3-1.6x slower).The AI Shortcut: How DeepSeek Cracked ChatGPT’s Secrets for Cheap
- Because of US sanctions on China's advanced chips, top-tier GPUs like the H100 are no longer legally available to China, so Nvidia created a specialized chip for the Chinese market called the H800, which is essentially a water-downed version of the H100 with reduced clock speed but the same advanced architecture.The AI Shortcut: How DeepSeek Cracked ChatGPT’s Secrets for Cheap
- DeepSeek's claim to train a model at the scale of GPT-4 in China's restricted chip environment might not be as miraculous as it seems given that the H800 constraint is less deadly than many assumed and cost-performance tradeoffs mean comparable total compute is achievable.The AI Shortcut: How DeepSeek Cracked ChatGPT’s Secrets for Cheap
- The H800 is priced at approximately 210,000 yuan in China while the H100 costs around 250,000 yuan, making the H800 about 16% cheaper; therefore, with the same budget, buyers could purchase more H800 chips and lose only about 8% of total performance compared to buying H100s.The AI Shortcut: How DeepSeek Cracked ChatGPT’s Secrets for Cheap
- The H800 has performance about 60% to 77% of the H100 (1.3 to 1.6 times slower), but is priced at approximately 210,000 Chinese yuan compared to 250,000 yuan for the H100 (23% lower price, 16% cheaper), meaning if sticking to the same budget one could buy more H800s and lose only about 8% of total performance compared to buying H100s.The AI Shortcut: How DeepSeek Cracked ChatGPT’s Secrets for Cheap
- Given the H800's cost advantage and retained performance, US sanctions may not have as deadly an impact on China's large model training as many might have assumed.The AI Shortcut: How DeepSeek Cracked ChatGPT’s Secrets for Cheap