What is a Perceptron?
A Perceptron is the simplest binary classifier: it computes a weighted sum of inputs and fires if the result exceeds a threshold. It can only solve linearly separable problems. Adding hidden layers creates a Multi-Layer Perceptron capable of learning arbitrary decision boundaries.