Task: Delta Rule

• Adaline Rule
• Widrow-Hoff Rule
• Least Mean Squares (LMS) Rule 

Change From Perceptron

• Replace the step function in the with a continuous (differentiable) activation function, e.g linear
• For classification problems, use the step function only to determine the class and not to update the weights.
• Note: this is the same algorithm we saw for regression. All that really differs is how the classes are determined.