causal

LLM scaling works because training is automatable

Scaling has worked for LLMs because the training process—scrape internet text, mask the last word, and ask the network to predict it—is essentially hands-off and requires no human input, making it fully automatable and therefore amenable to scaling up.

causalpending

Speaker

Anil Ananthaswamy

Evidence Quote

“this entire process of training a large language model is more or less hands off in terms of human inputs... that can be completely automated and hence amenable to scaling up.”

Source

336 | Anil Ananthaswamy on the Mathematics of Neural Nets and AI— Sean Carroll's Mindscape
Created: 6/13/2026, 12:20:04 AM

Your notes

Loading notes...