acceptodds
Under review as a conference paper at ICLR 2027

Branch-Jacobi: Prefix-Conditioned Multi-Pass Drafting for Speculative Decoding

Abstract

Block-diffusion drafters predict token blocks in parallel, but later predictions cannot condition on tokens selected earlier in the same pass. We introduce Branch-Jacobi, which reuses one DFlash-style drafter for multi-pass prefix-conditioned refinement. Each pass packs prefix-MASK branches into one forward call. Consecutive first-MASK checks identify the proposal's common prefix with a drafter-autoregressive path; selecting one complete branch extends certification before linear target verification. We prove sound prefix certification for deterministic greedy drafting under fixed cycle conditions and equivalent branch evaluation. Moving-anchor training and causal prefix supervision align the drafter with variable-prefix queries. Across seven math, code, and chat benchmarks on Qwen3-4B and Qwen3-8B at temperatures 0 and 1, a three-layer drafter using three passes per cycle achieves – geometric-mean decode-stage speedups over target autoregressive decoding, exceeding DFlash by – while increasing average acceptance length.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.