Saturation Makes Quantization Error Additive: A Coverage Model with a Certificate
Mixed-precision quantization must decide which parts of a model to keep at higher precision. A common premise, shared by sensitivity-based methods such as HAWQ and CoopQ, is that the loss from quantizing a set of layers can be reconstructed from per-layer or pairwise sensitivities measured in isolation. We test this premise at the 4-bit weight-and-activation precisions now being deployed, treating the change in loss $f(S)$ from quantizing a layer set $S$ as a set function on the Boolean cube and analyzing it through two classical changes of basis. This analysis yields two findings. First, across configurations drawn from the deployment distribution, 85--93\% of the variance of $f$ is expl...
| Authors | Joshua Hill |
|---|---|
| Primary category | cs.LG |
| Published | 14 July 2026 |
| Last updated at source | 14 July 2026 |
Connected in the knowledge graph
- malaiwah/Qwen3.8-27B-EXL3-K5K6Model · cited by
- brandonmusic/shapleymcg-qwen3-30b-a3b-reproducibilityDataset · cited by
- malaiwah/Qwen3.8-27B-EXL3-K5K6-hydratedModel · cited by
- brandonmusic/Qwen3-30B-A3B-ShapleyMCG-K34-Validation-ReconstructionModel · cited by
- malaiwah/Qwen3.8-27B-EXL3-K5K6-contextModel · cited by
- malaiwah/Qwen3.8-27B-K4Model · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.