At OpenAI from the earliest days, the fundamental hypothesis was that predicting the next token (word, pixel, etc.) is sufficient for solving unsupervised learning, and prediction is equivalent to compression of data.

factualpending

Speaker

Ilya Sutskever

Evidence Quote

“At OpenAI from the earliest days, we were exploring the idea that predicting the next thing is all you need. Really it's about compression. Prediction is compression.”

Source

The Mastermind Behind GPT-4 and the Future of AI | Ilya Sutskever— Eye on AI
Created: 8/10/2026, 10:48:45 PM

Your notes

Loading notes...