- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
SwiftDLM combines cross-state consistency distillation along teacher trajectories with reinforcement learning that jointly considers correctness and decoding steps, forming a two-stage post-training framework for masked diffusion language models. Experiments on LLaDA and Dream demonstrate improved decoding speed and generation quality under few-step decoding.
Critical strengths
1. Practically relevant problem with strong efficiency gains across models and tasks.
The paper targets a key bottleneck in dLLM inference: reducing decoding steps without sacrificing generation quality. Experiments on LLaDA and Dream across math reasoning and code generation show consistent gains. On LLaDA/GSM8K, SwiftDLM improves accuracy from 74.7% to 81.6% over dParallel while reducing average decoding steps from 30 to 25, demonstrating clear practical value.
2. Well-motivated two-stage design with complementary effects validated by ablation.
The paper compares Stage I, Stage II, and the full method, and also applies the same Stage II RL to a dParallel checkpoint. Although SwiftDLM Stage I starts with lower accuracy than dParallel, it achieves better accuracy and efficiency after the same RL stage, suggesting that consistency distillation provides a more suitable initialization for subsequent reinforcement learning.
Critical weaknesses
W1. The novelty of the RL component is not sufficiently established compared with prior efficiency-aware RL approaches.
The second stage optimizes decoding trajectories using a reward that jointly considers generation quality and decoding efficiency. However, the general idea of incorporating efficiency objectives into RL optimization has been explored in prior works. Prior works such as LightningRL and dUltra have explored RL formulations where generation quality and efficiency considerations are jointly optimized. A comparison with RL-based dLLM acceleration approaches would significantly strengthen the contribution claim.
W2. The evaluation does not fully characterize practical inference efficiency.
The paper evaluates efficiency using decoding steps, latency, and speedup. While these metrics are useful, they do not fully characterize dLLM inference efficiency.
Since SwiftDLM explicitly optimizes decoding trajectories and encourages fewer denoising steps, it is important to verify whether the reduction in decoding steps translates into improved effective throughput. Metrics such as tokens-per-second (TPS), tokens-per-forward-pass (TPF), or similar throughput-oriented measurements would provide a more complete evaluation of practical acceleration.
Questions for authors
Q1: The RL stage appears closely related to prior efficiency-aware RL approaches. Could the authors clarify the key novelty of SwiftDLM's RL formulation compared with methods such as dUltra and LightningRL? Specifically, which component is responsible for the main gains?
Q2: The paper reports latency and decoding steps as efficiency metrics. Could the authors provide throughput-oriented metrics such as TPS/TPF?