The most surprising aspect of scaling transformer models for Sutskever is not any specific emergent capability, but rather that the models work and produce useful behavior at all, given his contrast with the pre-AlexNet era when neural networks produced nothing.
factualpending
Speaker
Ilya SutskeverEvidence Quote
“the most surprising thing for me is the whole thing works at all... just the fact that they work and they do these amazing things.”
Source
No Priors Ep. 39 | With OpenAI Co-Founder & Chief Scientist Ilya Sutskever— No Priors: AI, Machine Learning, Tech, & StartupsCreated: 8/10/2026, 10:47:05 PM
Your notes
Loading notes...