forecast
Scaling LLMs alone won't reach general intelligence
Scaling up large language models alone will not produce generalized intelligence because there is no mathematical guarantee a language model is accurate—it outputs a probability distribution with inbuilt stochasticity and only asymptotically approaches correctness—and because LLMs are extremely sample-inefficient; reaching transformative AI capable of generalizing beyond training data likely requires two or three further breakthroughs comparable to the attention paper.
forecastpending
Speaker
Anil AnanthaswamyEvidence Quote
“we're probably one or two steps away like that from an AI that is capable of generalizing to questions that it hasn't seen, answering things or questions about patterns that don't exist in the training data. So effectively going back to our early argument, doing what Kepler did.”
Created: 6/13/2026, 12:20:04 AM
Your notes
Loading notes...