Gemini Pro achieved the second-highest Elo rating on the LMSYS chatbot arena (which evaluates models via user-submitted prompts and anonymous pairwise comparisons across ~30 models), demonstrating competitive performance against other state-of-the-art chatbots.

factualpending

Speaker

Justin Dozat (or primary speaker)

Evidence Quote

“the pro level model actually achieves the second highest Elo score in this thing and there's probably like 30 different models.”

Source

Jeff Dean (Google): Exciting Trends in Machine Learning— Rice Ken Kennedy Institute
Created: 8/11/2026, 1:28:51 AM

Your notes

Loading notes...