Least Mean Square (LMS)
A steepest descent search algorithm that uses a very efficient estimate of the gradient (the product of the error and the input):
w
(
n
+ 1 =
w
(
n
) +
x
(
n
)
(
n
)