Sign inGet started
Paper · arXiv

The Calibration Floor: Format Repair Can Masquerade as Self-Correction at Small-to-Mid Scale

Accuracy changes after language-model self-revision are usually interpreted as changes in reasoning. We show this can fail at the answer-extraction boundary, and test the failure causally rather than only observationally. Across Qwen3.5 (0.8B-9B), Gemma-4-12B, and two frontier models via API (Tencent Hy3, Nvidia Nemotron-3-Ultra-550B) in 29 primary cells plus a frontier arm, we decompose the always-revise accuracy shift into a content margin (both answers parseable) and format-recovery/loss margins (parseability changes). On 12 cells with meaningful unparseable-answer rates, format effects exceed content effects (Wilcoxon p=1.7e-3). To test this causally, we force already-generated reason...

AuthorsMingguang Chen, Bo Qu, Licheng Wang
Primary categorycs.CL
Published5 August 2026
Last updated at source5 August 2026
cs.CL
Embed this entry
<iframe src="https://silytics.si/embed/item/7c5b2045-0ced-4bd0-9528-d2beeb235e23" width="420" height="190" style="border:0" loading="lazy" title="Silytics entry"></iframe>

Free, no tracking. More about feeds and embeds.

Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.