normative

Test set must stay untouched by tuning

The test set must be used only once the model is finished, because if it is used to guide tweaks it becomes part of the training feedback loop and can no longer provide an honest out-of-sample estimate.

normativepending

Speaker

Jeremiah

Evidence Quote

“all of a sudden, the test set has, in a very implicit way, become part of the training process”

Source

Machine Learning in Investing— Invest Like the Best
Created: 11/11/2026, 7:15:49 PM

Your notes

Loading notes...