Prediction as Compression

Definition

The principle that predicting the next token in a sequence is equivalent to compressing data. Better prediction necessarily requires understanding the underlying generative process that produced the data, making prediction a proxy for learning meaningful representations.

Cast within

No topic-region cast yet — this appears once Prediction as Compression's compiled claims are aligned into a topic region's argument tree.

Claims mentioning Prediction as Compression (1)

Your notes

Loading notes...