What are residual connections in deep networks?
Residual connections are shortcut paths that add a layer's input directly to its output, allowing gradients to bypass layers during backpropagation. Introduced in ResNet, they enable training of very deep networks (100+ layers) by preventing vanishing gradients.