Thinking Leakage: A Causal Audit of NoThink Post-Training in Hybrid Reasoning Models
Post-training hybrid reasoning models in NoThink mode has attracted growing interest as a way to improve performance while keeping inference fast. However, these gains may draw on thinking behavior already accessible through the base model's Think mode. We formulate this thinking leakage in a causal mediation framework and audit its contribution using bidirectional interventions along a simple base-derived activation direction. Across three models and three post-training methods on competition math benchmarks, we find that leakage is real, causal, and substantial: behavioral and representational analyses reveal shifts toward Think, steering the base model along this direction reproduces m...
| Authors | Zehao Liu, Vasant G. Honavar |
|---|---|
| Primary category | cs.LG |
| Published | 23 September 2026 |
| Last updated at source | 23 September 2026 |
Popularity, last 7 days
0 now. Counts as reported by the source, snapshotted daily by Silytics.
Connected in the knowledge graph
- zml5418/SFT-Qwen3-4BModel · cited by
- zml5418/OPSD-Qwen3-8BModel · cited by
- zml5418/OPSD-MiniCPM4.1-8BModel · cited by
- zml5418/GRPO-MiniCPM4.1-8BModel · cited by
- zml5418/thinking-leakage-rolloutsDataset · cited by
- zml5418/OPSD-LoRA-Qwen3-4BModel · cited by
- zml5418/GRPO-Qwen3-8BModel · cited by
- zml5418/SFT-MiniCPM4.1-8BModel · cited by
- zml5418/OPSD-Qwen3-4BModel · cited by
- zml5418/SFT-Qwen3-8BModel · cited by
- zml5418/OPSD-LoRA-Qwen3-8BModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 23 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.