causal
LLM scaling works because training is automatable
Scaling has worked for LLMs because the training process—scrape internet text, mask the last word, and ask the network to predict it—is essentially hands-off and requires no human input, making it fully automatable and therefore amenable to scaling up.
causalpending
Speaker
Anil AnanthaswamyEvidence Quote
“this entire process of training a large language model is more or less hands off in terms of human inputs... that can be completely automated and hence amenable to scaling up.”
Created: 6/13/2026, 12:20:04 AM
Your notes
Loading notes...