factual

Scaling as a word redirected the whole field

The arrival of scaling laws and GPT-3 turned 'scaling' into one powerful word that told everyone what to do, redirecting the field from tinkering research into a low-risk recipe of mixing more compute and data into a neural net—a vivid example of how language shapes thought and corporate behavior.

factualpending

Speaker

Ilya Sutskever

Evidence Quote

“"Scaling" is just one word, but it's such a powerful word because it informs people what to do.”

Source

Ilya Sutskever – We're moving from the age of scaling to the age of research— Dwarkesh Patel Podcast
Created: 6/13/2026, 3:24:31 AM

Your notes

Loading notes...