What Quantization Changes in a Language Model (and What It Leaves Alone)
Quantization rewrites a model's weights in lower precision while leaving its architecture, tokenizer, and parameter count intact. The memory savings are predictable; the quality cost is not,…