causal

Momentum helps escape local minima

Plain gradient descent can get stuck in local minima, a valley far above sea level; adding momentum, which carries parameters in their prior direction, helps the optimizer avoid such traps.

causalpending

Speaker

Jeremiah

Evidence Quote

“what if we end up in a valley but we're still many thousands of feet above sea level?”

Source

Machine Learning in Investing— Invest Like the Best
Created: 11/11/2026, 7:15:49 PM

Your notes

Loading notes...