- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes XPress, a causal refiner that restores missing causal dependencies in diffusion drafters to improve the acceptance rate of block-diffusion drafters in speculative decoding. The method addresses a key limitation of dFlash: although it achieves higher drafting throughput, its relatively low acceptance rate limits the overall efficiency of speculative decoding. By reintroducing causal information into the diffusion drafter, XPress aims to improve the acceptance rate while preserving the benefits of parallel token generation. Experiments on Qwen3-series demonstrate improvements in both acceptance length and end-to-end throughput.
Critical strengths
- Demonstrated performance improvements. XPress improves the average acceptance length of the dFlash drafter by approximately 35% and achieves an average end-to-end throughput improvement of approximately 1.3× on Qwen3-8B, demonstrating its practical effectiveness.
- Addresses a meaningful and well-motivated challenge. dFlash generates an entire block of tokens in parallel, improving drafting throughput. However, unlike autoregressive drafting, each token is not explicitly conditioned on its preceding tokens, which can result in a lower acceptance rate and consequently limit the overall throughput of speculative decoding. The paper identifies this important trade-off and proposes a method to reintroduce causal information into the diffusion drafter.
- Clear presentation and motivation. The paper is well-written and easy to follow. The motivation is clear, and the problem is well-defined, making the proposed approach straightforward to understand.
Critical weaknesses
- Potentially high training overhead. XPress requires joint training with the draft model, which may introduce substantial computational overhead. However, the paper does not provide sufficient information about the associated training costs, making it difficult to assess the overall cost-effectiveness of the proposed approach.
- Incomplete isolation of the benefits of causal modeling and parallel refinement. The paper does not sufficiently disentangle the contributions of causal modeling and parallel refinement. More comprehensive ablation studies are needed to clarify the independent benefits of these mechanisms and identify which components are primarily responsible for the observed improvements.
- Limited analysis of practical overhead. Although the paper characterizes refinement latency, it lacks a sufficiently comprehensive analysis of the additional parameter count, GPU memory consumption, and how the refinement overhead scales with block size and vocabulary size. These factors are important for assessing the practical deployment costs and scalability of XPress.
- Limited generalizability of the experimental evaluation. The proposed method is evaluated only with dFlash as the diffusion drafter, and the experiments are restricted to the Qwen model family. Its effectiveness across different diffusion drafting architectures and target model families remains unverified, limiting the generalizability of the reported results.
Questions for authors
- What is the computational cost of training XPress? Specifically, how many GPUs and how much training time are required?
- How does XPress perform with other diffusion drafters and target model architectures?
- What motivates the decision to jointly train XPress with the draft model? Would it be possible to train the causal refiner independently, potentially reducing the training cost?
- Domino and DSpark have already introduced causal correction mechanisms. XPress primarily employs Jacobi-style parallel refinement and a broader scope of causal mixing. Could the authors clarify the independent contributions of these mechanisms relative to existing approaches? Specifically, how much improvement can be attributed to each component individually?
Thank you for the detailed rebuttal and for running the additional experiments. The new results address the concerns I raised in my review and strengthen the empirical support for the paper’s conclusions.
I see XPress as a solid incremental contribution to speculative decoding. In light of this, I will keep my score.