kleinnner/camus-10-kv-cache-quantization

We attempted KV cache quantization to Q4 — and documented why it fails on the qwen2vl architecture. KV Cache Quantization Attempt: type_k/type_v on qwen2vl Architecture The Problem The KV cache consumes significant memory bandwidth during autoregressive generation. On CPU-bound systems, memory bandwidth is the primary bottleneck. Quantizing the KV cache from FP16 to Q4 theoretically halves memory bandwidth requirements. What We Built We attempted… See the full description on the dataset page: https://huggingface.co/datasets/kleinnner/camus-10-kv-cache-quantization.

<iframe src="https://silytics.si/embed/item/769a8154-7ef6-49f2-8c8c-bc61d2c66f6d" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.