What are activation functions in neural networks?
Activation functions introduce non-linearity between layers of a neural network. Without them, stacking layers reduces to a single linear transformation. They determine the output range of a neuron, influence gradient flow during backpropagation, and are critical to a network's expressive power.