•Hebb rule has many problems
–Only learns orthogonal patterns
–Produces error when overtraining
–Unable to deal with linear dependence
•The delta rule overcomes many of these problems
–Can deal with some correlated patterns
–Only modifies weights when errors exist
–Still cannot deal with linear dependence