factual

PAC Learning Predicted LLM Compute Costs

The PAC model correctly anticipated modern large language models: it promised that the computation needed to learn well would be large but still polynomial-time and therefore doable, which is borne out by LLMs costing millions of dollars to train.

factualpending

Speaker

Leslie Valiant

Evidence Quote

“these big LLMs do spend millions of dollars in being trained. So that's exactly what the what the model was that you have to have a model of learning, which somehow promised you that the amount of computation needed may be much, but it was still polynomial time. It was still doable.”

Source

272 | Leslie Valiant on Learning and Educability in Computers and People— Sean Carroll's Mindscape
Created: 6/13/2026, 12:22:31 AM

Your notes

Loading notes...