The key breakthrough enabling deep learning's success in 2012 was not a new algorithmic invention but the combination of three factors: large amounts of supervised data from the internet, GPU compute becoming available, and the conviction among researchers like Hinton that scaling neural networks on big data would work when previous skeptics doubted it.

causalpending

Speaker

Ilya Sutskever

Evidence Quote

“the ideas were all there the thing that was missing was a lot of supervised data and a lot of compute once you have a lot of supervised data and a lot of compute then there is a third thing which is needed as well and that is conviction”

Source

Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94— Lex Fridman
Created: 8/10/2026, 10:49:52 PM

Your notes

Loading notes...