The most surprising aspect of scaling transformer models for Sutskever is not any specific emergent capability, but rather that the models work and produce useful behavior at all, given his contrast with the pre-AlexNet era when neural networks produced nothing.

factualpending

Speaker

Ilya Sutskever

Evidence Quote

“the most surprising thing for me is the whole thing works at all... just the fact that they work and they do these amazing things.”

Source

No Priors Ep. 39 | With OpenAI Co-Founder & Chief Scientist Ilya Sutskever— No Priors: AI, Machine Learning, Tech, & Startups
Created: 8/10/2026, 10:47:05 PM

Your notes

Loading notes...