What is a Transformer?
A Transformer is a neural network architecture based on self-attention mechanisms that model relationships between all input tokens simultaneously. Unlike RNNs, Transformers process sequences in parallel and capture global context, making them the dominant architecture for NLP, vision, and multimodal tasks.