Large language model parameter counts have grown exponentially: GPT-2 had 1.5 billion parameters (2019), T5 had 11 billion, GPT-3 had significantly more, and Gemini (co-led by the speaker) continues this progression with multiple sizes including Ultra, Pro, and Nano variants optimized for different deployment scenarios.

factualpending

Speaker

Justin Basilico

Evidence Quote

“the project I co-lead with my colleague Oriol Vinyals... the V1 generation of Gemini comes in three different sizes. So, Ultra is the kind of the largest scale uh, and most capable model we have”

Source

Jeff Dean (Google): Exciting Trends in Machine Learning— Rice Ken Kennedy Institute
Created: 8/11/2026, 1:28:51 AM

Your notes

Loading notes...