forecast

Scaling LLMs alone won't reach general intelligence

Scaling up large language models alone will not produce generalized intelligence because there is no mathematical guarantee a language model is accurate—it outputs a probability distribution with inbuilt stochasticity and only asymptotically approaches correctness—and because LLMs are extremely sample-inefficient; reaching transformative AI capable of generalizing beyond training data likely requires two or three further breakthroughs comparable to the attention paper.

forecastpending

Speaker

Anil Ananthaswamy

Evidence Quote

“we're probably one or two steps away like that from an AI that is capable of generalizing to questions that it hasn't seen, answering things or questions about patterns that don't exist in the training data. So effectively going back to our early argument, doing what Kepler did.”

Source

336 | Anil Ananthaswamy on the Mathematics of Neural Nets and AI— Sean Carroll's Mindscape
Created: 6/13/2026, 12:20:04 AM

Your notes

Loading notes...