Beyond Parallel Blindness: Information Floors and Model Gaps in Block Drafting
Block drafters propose several tokens in one forward pass, before earlier target tokens are realised. Their rejection mixes two losses: missing within-block path information and imperfect modelling of observable information. Accepted length cannot distinguish them. We separate the two with an information floor, the minimum expected rejection at a specified conditioning order; rejection above this floor is the model gap. Measurements across four domains and four open-weight targets, plus floor estimates on a frontier API target, yield three findings. First, the all-parallel floor reaches $0.286$ at the final slot on Qwen3-4B, limiting even the best proposal to $71\%$ per-slot acceptance. S...
| Authors | Xinwei Qiang, Xiang Fang, Chang Chen et al. |
|---|---|
| Primary category | cs.LG |
| Published | 27 August 2026 |
| Last updated at source | 27 September 2026 |
Connected in the knowledge graph
- TIE-Pilot/qwen3-4b-perfectblend-deepspec-rolloutDataset · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.