Natural Language Processing (NLP)
NLP turns raw text into machine-readable representations. Tokenisation, embeddings, and language models are the pipeline that lets machines read, write and reason about language.
Domain Hub · 6 Interactive Modules
Explore the foundations and frontiers of language models, self-attention mechanisms, diffusion pipelines, RAG systems, and multimodal vision-language architectures.
NLP turns raw text into machine-readable representations. Tokenisation, embeddings, and language models are the pipeline that lets machines read, write and reason about language.
Transformers replaced RNNs for sequence modelling. Self-attention relates every token to every other in parallel, enabling global context with O(n²) compute—the foundation of GPT, BERT, and modern LLMs.
Generative models learn the distribution of training data and sample from it to create new content—images, text, audio, video. Diffusion, GANs, and autoregressive LLMs dominate the field.
RAG grounds LLM outputs in retrieved external knowledge, reducing hallucination. Advanced variants add semantic caching, hybrid BM25+dense retrieval, and agentic retrieval loops.
Multimodal models process and generate across text, image, audio, and video simultaneously. Cross-modal alignment maps different modalities into a shared embedding space.
Vector databases store high-dimensional embeddings and enable sub-linear approximate nearest neighbour search. They are the retrieval backbone of RAG systems and semantic search engines.