factual
Internet text data exhausted, per Sutskever
Ilya Sutskever stated at NeurIPS that there is one internet and it has been trained on, so there is no more data for text models, meaning further text gains depend on tricks such as cheaper models and reasoning rather than raw scale.
factualpending
Speaker
AlexEvidence Quote
“There's one Internet and we've trained on it. There's no more data.”
Source
Alex Wiltschko - Giving Computers A Sense Of Smell - [Invest Like the Best, EP.415]— Invest Like the BestCreated: 11/14/2026, 2:46:45 AM
Your notes
Loading notes...