factual
PAC Learning Predicted LLM Compute Costs
The PAC model correctly anticipated modern large language models: it promised that the computation needed to learn well would be large but still polynomial-time and therefore doable, which is borne out by LLMs costing millions of dollars to train.
factualpending
Speaker
Leslie ValiantEvidence Quote
“these big LLMs do spend millions of dollars in being trained. So that's exactly what the what the model was that you have to have a model of learning, which somehow promised you that the amount of computation needed may be much, but it was still polynomial time. It was still doable.”
Source
272 | Leslie Valiant on Learning and Educability in Computers and People— Sean Carroll's MindscapeCreated: 6/13/2026, 12:22:31 AM
Your notes
Loading notes...