At OpenAI from the earliest days, the fundamental hypothesis was that predicting the next token (word, pixel, etc.) is sufficient for solving unsupervised learning, and prediction is equivalent to compression of data.
factualpending
Speaker
Ilya SutskeverEvidence Quote
“At OpenAI from the earliest days, we were exploring the idea that predicting the next thing is all you need. Really it's about compression. Prediction is compression.”
Created: 8/10/2026, 10:48:45 PM
Your notes
Loading notes...