- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SetCommit, a training-free method for coordinated parallel token commitment. SetCommit selects a commitment set that balances token reliability against local joint commitment risk, preserving conditioning opportunities for subsequent denoising steps. It further performs budget-neutral local exchanges, replacing vulnerable earlier commitments when newly revealed context supports more reliable alternatives. SetCommit requires no retraining or architectural modification and is compatible with existing diffusion decoding strategies. Experiments with LLaDA-8B and Dream-7B on multiple benchmarks show the effectiveness of the proposed method.
Critical strengths
-
The paper is written clearly and is easy to understand.
-
The experiments on LLaDA and Dream are comprehensive.
Critical weaknesses
-
The core idea is not novel, many previous papers on diffusion language model decoding have used similar approaches.
-
The experiments in the article are mainly on full-sequence masked DLLMs. The experiments on block-diffusion-based LLaDA 2.0 and LLaDA 2.1 are very incomplete.
-
The paper's figures have significant room for improvement.
-
Does the proposed method still work well on step-distilled DLLMs, such as dparallel [1] or d3llm [2]?
-
The introduction and discussion of previous work in the related work section are very incomplete.
[1] dParallel: Learnable Parallel Decoding for dLLMs
[2] d3LLM: Ultra-Fast Diffusion LLM using Pseudo-Trajectory Distillation
Questions for authors
Please see the weaknesses