The ability to train large neural networks at AlexNet scale required not just the existence of gradient descent as an algorithm, but specific technical insights about how to make gradient descent work in practice, which most machine learning researchers did not possess at the time.
causalpending
Speaker
Ilya SutskeverEvidence Quote
“They didn't have the technical ability to turn this idea into reality. You needed not only to code the neural net, you need to do a bunch of things right.”
Source
No Priors Ep. 39 | With OpenAI Co-Founder & Chief Scientist Ilya Sutskever— No Priors: AI, Machine Learning, Tech, & StartupsCreated: 8/10/2026, 10:47:05 PM
Your notes
Loading notes...