factual

Widrow's LMS is true precursor to backpropagation

Bernard Widrow's adaptive digital filter work led to the Widrow-Hoff Least Mean Square algorithm, which is the true precursor to today's backpropagation; it was effectively a very noisy, algebraic version of stochastic gradient descent that avoided calculus so it could be implemented directly in hardware.

factualpending

Speaker

Anil Ananthaswamy

Evidence Quote

“the algorithm that Widrow came up with to build this linear classifier is actually the true precursor to today's back propagation algorithm, which is used to train artificial neural networks.”

Source

336 | Anil Ananthaswamy on the Mathematics of Neural Nets and AI— Sean Carroll's Mindscape
Created: 6/13/2026, 12:20:04 AM

Your notes

Loading notes...