causal
Momentum helps escape local minima
Plain gradient descent can get stuck in local minima, a valley far above sea level; adding momentum, which carries parameters in their prior direction, helps the optimizer avoid such traps.
causalpending
Speaker
JeremiahEvidence Quote
“what if we end up in a valley but we're still many thousands of feet above sea level?”
Created: 11/11/2026, 7:15:49 PM
Your notes
Loading notes...