Learning statistical regularities is far more significant than commonly believed because prediction and compression are intimately connected—to predict data well and compress it well, you must understand more and more about the underlying processes that produced the data, which means generative models with high fidelity will achieve a shocking degree of understanding of the world.
causalpending
Speaker
Ilya SutskeverEvidence Quote
“As our generative models become extraordinarily good, they will have I claim a shocking degree of understanding. A shocking degree of understanding of the world and many of its subtleties.”
Created: 8/10/2026, 10:48:45 PM
Your notes
Loading notes...