thaki-AI/daily-paper-2026-09-17-tool-call-quantization-cliff

The Tool-Call Cliff: Measuring the Accuracy Decay of Agentic Structured Output Under Low-Bit Quantization in Self-Hosted H200 Serving TL;DR — We formalize the tool-call cliff - the hypothesis that agentic structured tool calls decay faster than free-form prose under NVFP4/8-bit quantization - as an accuracy tax and a cliff ratio against a free-form control, derive two falsifiable predictions (a per-category failure-mode composition and a superlinear 8-to-4-bit tax jump), and… See the full description on the dataset page: https://huggingface.co/datasets/thaki-AI/daily-paper-2026-09-17-tool-call

<iframe src="https://silytics.si/embed/item/fbbb5a00-4b3a-4b3e-a4ee-dac3494d99f4" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Silytics shows public metadata from Hugging Face and links to the original. Information may be incomplete or out of date. Last refreshed 18 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.