Large language model parameter counts have grown exponentially: GPT-2 had 1.5 billion parameters (2019), T5 had 11 billion, GPT-3 had significantly more, and Gemini (co-led by the speaker) continues this progression with multiple sizes including Ultra, Pro, and Nano variants optimized for different deployment scenarios.
factualpending
Speaker
Justin BasilicoEvidence Quote
“the project I co-lead with my colleague Oriol Vinyals... the V1 generation of Gemini comes in three different sizes. So, Ultra is the kind of the largest scale uh, and most capable model we have”
Created: 8/11/2026, 1:28:51 AM
Your notes
Loading notes...