factual
Foundation Models Rely on Thousands of Human Annotators
Every company training foundation models employs several thousand people full-time to create and rate training data by correcting answers to queries the model handles poorly; this manual annotation is what actually makes the models useful, beyond mere next-word prediction across internet text.
factualpending
Speaker
François CholletEvidence Quote
“every company out there that's training this foundation models is employing typically several thousands of people just doing this full time. And this is, by the way, this is very much what makes these models useful.”
Source
280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's MindscapeCreated: 6/13/2026, 12:07:39 AM
Your notes
Loading notes...