What is Backpropagation?
Backpropagation is an efficient algorithm for computing the gradient of a loss function with respect to all network parameters. It applies the chain rule backwards through the computation graph, enabling gradient-based optimisation of neural networks with millions of parameters.