Active learning (selecting which data to train on) will be a major breakthrough area, though it requires problems that actually need it to succeed; artificial tasks on MNIST won't convince anyone, which is why active learning research might be more fruitful when driven by real problems requiring it.

forecastpending

Speaker

Ilya Sutskever

Evidence Quote

“for something like active learning or in fact for any kind of capability like active learning the thing that it really needs is a problem it needs a problem that requires it”

Source

Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94— Lex Fridman
Created: 8/10/2026, 10:49:52 PM

Your notes

Loading notes...