factual
Scaling as a word redirected the whole field
The arrival of scaling laws and GPT-3 turned 'scaling' into one powerful word that told everyone what to do, redirecting the field from tinkering research into a low-risk recipe of mixing more compute and data into a neural net—a vivid example of how language shapes thought and corporate behavior.
factualpending
Speaker
Ilya SutskeverEvidence Quote
“"Scaling" is just one word, but it's such a powerful word because it informs people what to do.”
Source
Ilya Sutskever – We're moving from the age of scaling to the age of research— Dwarkesh Patel PodcastCreated: 6/13/2026, 3:24:31 AM
Your notes
Loading notes...