Learning statistical regularities is far more significant than commonly believed because prediction and compression are intimately connected—to predict data well and compress it well, you must understand more and more about the underlying processes that produced the data, which means generative models with high fidelity will achieve a shocking degree of understanding of the world.

causalpending

Speaker

Ilya Sutskever

Evidence Quote

“As our generative models become extraordinarily good, they will have I claim a shocking degree of understanding. A shocking degree of understanding of the world and many of its subtleties.”

Source

The Mastermind Behind GPT-4 and the Future of AI | Ilya Sutskever— Eye on AI
Created: 8/10/2026, 10:48:45 PM

Your notes

Loading notes...