normative

Models must have fewer parameters than observations

A good physical/mathematical theory is a compression of the universe: a model with as many parameters as data points (overfitted) is useless, but a model with few parameters explaining vast amounts of data (like the ~14-parameter dark matter model explaining petabytes) is powerful—the more compression, the better the theory.

normativepending

Speaker

Terence Tao

Evidence Quote

“the mathematical point over the model is that you want to have fewer parameters in your model and data points in your observational set”

Source

Terence Tao— Lex Fridman Podcast
Created: 6/13/2026, 3:35:53 AM

Your notes

Loading notes...