The key breakthrough enabling deep learning's success in 2012 was not a new algorithmic invention but the combination of three factors: large amounts of supervised data from the internet, GPU compute becoming available, and the conviction among researchers like Hinton that scaling neural networks on big data would work when previous skeptics doubted it.
causalpending
Speaker
Ilya SutskeverEvidence Quote
“the ideas were all there the thing that was missing was a lot of supervised data and a lot of compute once you have a lot of supervised data and a lot of compute then there is a third thing which is needed as well and that is conviction”
Created: 8/10/2026, 10:49:52 PM
Your notes
Loading notes...