The word 'scaling' is linguistically powerful and shaped the field's thinking by directing everyone to pursue scaling recipes, but now that scale is very large, 100x more compute would not solve fundamental problems like generalization, requiring different approaches.
normativepending
Speaker
Ilya SutskeverEvidence Quote
“'Scaling' is just one word, but it's such a powerful word because it informs people what to do... I don't think that's true [that 100x more would transform everything]”
Created: 8/12/2026, 6:07:19 PM
My Notes
Loading notes...