- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies the trade-off between efficiency and accuracy in parallel decoding for dLLMs. It trains a small MLP to predict whether each candidate token is "stable". The experiments also analyze token scoring, stopping rules, local stability and final task accuracy in dLLMs.
Critical strengths
None
Critical weaknesses
W1. The presentation quality of the paper is poor. Many of the figures look like AI-generated framework diagrams. The appendix reports a lot of content that is unrelated to the paper's topic and core contribution, so the overall structure reads like a technical report. This makes the paper difficult to read.
W2. The writing of this paper lacks logical coherence. Overall, it does not meet ICLR's style and standards: it has neither a coherent story nor a clear motivation.
W3. The novelty of this work is limited. The performance gains rely mainly on the confidence-ordered cumulative-product stopping rule, which has the same structure as EB-Sampler. Even the authors acknowledge, "We do not claim this rule as new." The prediction head requires additional training to estimate the "stability score". Yet in the experiments analyzing the score, it shows no clear advantage in task accuracy, and in some settings it even falls behind the training-free margin score (e.g., 64.67% vs. 65.13% at 30.8 NFE on Dream GSM8K; Table 13).
W4. The experimental reporting is insufficient and does not show a clear advantage. All experiments use a fixed generation length of 256 tokens (and mostly block size 32), so more settings should be explored. Training the prediction head involves training–test overlap: some of the training problems also appear in the evaluation sets (e.g., H_L is trained on HumanEval problems and evaluated on HumanEval). In addition, the head uses 13 input features, yet its local reference agreement differs from a confidence-only version by at most 0.17 pp, so the need for this feature design is not evident. Finally, EB-Sampler, the closest prior work, is not included as a baseline. The appendix only contains an in-house entropy-budget control in two LLaDA-1.5 blocks, and it is not discussed.
W5. The paper reports a large number of tables but seriously lacks qualitative experiments, interpretability analysis, case studies, failure cases and a thorough efficiency analysis.
W6. Does the interaction between token scores and stopping rules claimed in this paper actually exist? This needs more experimental evidence, and it should be explained more clearly. In addition, the main text concludes from a non-significant result that "being locally more accurate does not mean being more accurate in the end, so the two are different objectives". Both points show that the rigor of the work at its current stage is very poor.
Questions for authors
This paper shows extensive signs of AI generation, and its writing, experimental design and method design are all poor. I strongly recommend that the authors thoroughly revise and improve this work. Submitting work in this state places an unnecessary burden on the review process.
The layout of the paper is poor. Readers have to search through both the main text and the appendices themselves to find the experimental evidence that the main claims rely on.