factual

Foundation Models Rely on Thousands of Human Annotators

Every company training foundation models employs several thousand people full-time to create and rate training data by correcting answers to queries the model handles poorly; this manual annotation is what actually makes the models useful, beyond mere next-word prediction across internet text.

factualpending

Speaker

François Chollet

Evidence Quote

“every company out there that's training this foundation models is employing typically several thousands of people just doing this full time. And this is, by the way, this is very much what makes these models useful.”

Source

280 | François Chollet on Deep Learning and the Meaning of Intelligence— Sean Carroll's Mindscape
Created: 6/13/2026, 12:07:39 AM

Your notes

Loading notes...