The word 'scaling' is linguistically powerful and shaped the field's thinking by directing everyone to pursue scaling recipes, but now that scale is very large, 100x more compute would not solve fundamental problems like generalization, requiring different approaches.

normativepending

Speaker

Ilya Sutskever

Evidence Quote

'Scaling' is just one word, but it's such a powerful word because it informs people what to do... I don't think that's true [that 100x more would transform everything]

Source

Ilya Sutskever – We're moving from the age of scaling to the age of researchDwarkesh Patel
Created: 8/12/2026, 6:07:19 PM

My Notes

Loading notes...