Smaller models like Llama 2 (70 billion parameters) are achieving 80% of the performance of models 10x larger, suggesting diminishing returns to raw scale and creating a viable alternative for applications that don't require frontier capabilities.
factualpending
Speaker
Eric SchmidtEvidence Quote
“Llama 2 is roughly 70 billion parameters. A model 10 times smaller is 80% of the big one.”
Source
AI and Quantum Computing: Glimpsing the Near Future | World Science Festival— World Science FestivalCreated: 8/12/2026, 10:28:01 PM
My Notes
Loading notes...