Deep Seek V3, combining multiple efficiency innovations (8-bit training, FP8 accumulation fix, mixture of experts, multi-head latent attention, multi-token prediction), is one of the most impressive base models on the market and has been available for some time (released December 2024).

factualpending

Speaker

Unidentified Speaker — The Engineering Unlocks Behind DeepSeek | YC Decoded [4Tmn-XP93m4]

Evidence Quote

“this makes V3 one of the most impressive based models on the market and it's been out for some time now”

Source

The Engineering Unlocks Behind DeepSeek | YC Decoded— Y Combinator
Created: 8/11/2026, 6:17:44 AM

Your notes

Loading notes...