Draft in Parallel, Condition Through Depth: Adjacent Causal Injection for Speculative Decoding
Parallel speculative drafting generates multiple candidates in one backbone pass, but independent token selection can produce inconsistent continuations that shorten the accepted prefix. Existing methods mostly leave conditional decoding to a lightweight module after the backbone, which limits the flow of predecessor information to successors. Our analysis of DFlash shows that early positions already form recoverable predictions in shallow layers, and that accurate adjacent predecessors help successors more when they enter earlier. We therefore propose DSpine, a drafter with causal conditioning injection throughout the backbone: at every layer, gated adjacent injection writes each predece...
| Authors | Haohui Zhang, Keyu Chen, Haocheng Sun et al. |
|---|---|
| Primary category | cs.LG |
| Published | 28 September 2026 |
| Last updated at source | 10 October 2026 |
Connected in the knowledge graph
- tencent/Qwen3-8B-DSpine-b16Model · cited by
- ProCreations/Qwen3.8-Flash-Next-DSpine-generationsDataset · cited by
- TechnoBaptist/Qwen3-8B-DSpine-b16Model · cited by
- ProCreations/Qwen3.8-Flash-Next-DSpine-previewModel · cited by
Models and datasets referencing this paper
Silytics shows public metadata from arXiv and links to the original. Information may be incomplete or out of date. Last refreshed 17 October 2026. Licenses and terms of the original apply to the work itself. Not financial, legal or professional advice.