What is model quantisation?
Model quantisation reduces the numerical precision of neural network weights and activations from high-precision floats (FP32) to lower-precision integers (INT8 or INT4). This reduces memory footprint by 4–8×, accelerates inference on integer-optimised hardware, and enables running large models on resource-constrained devices.