Least Mean Square (LMS)

A steepest descent search algorithm that uses a very efficient estimate of the gradient (the product of the error and the input):

w(n + 1 = w(n) + NEURAL AND ADAPTIVE SYSTEMS00090002.gifx(n)NEURAL AND ADAPTIVE SYSTEMS00090000.gif(n)