The ability to train large neural networks at AlexNet scale required not just the existence of gradient descent as an algorithm, but specific technical insights about how to make gradient descent work in practice, which most machine learning researchers did not possess at the time.

causalpending

Speaker

Ilya Sutskever

Evidence Quote

“They didn't have the technical ability to turn this idea into reality. You needed not only to code the neural net, you need to do a bunch of things right.”

Source

No Priors Ep. 39 | With OpenAI Co-Founder & Chief Scientist Ilya Sutskever— No Priors: AI, Machine Learning, Tech, & Startups
Created: 8/10/2026, 10:47:05 PM

Your notes

Loading notes...