- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper observed that as the number of denoising steps increases, the output distribution transitions from mostly invalid to mostly valid but incorrect, and then may transition to mostly correct. Based on this observation, the paper proposes verification-guided inference, which combines a deterministic checker and an independent verifier to filter outputs with smaller budgets and regenerate only those that failed the checks with larger budgets. On HumanEval and MBPP, the method improves accuracy from 41.1% to 48.0% with less generation compute.
Critical strengths
-
The paper provides good motivation and observations that surface validity can improve before semantic correctness. Although this may not be surprising, it is valuable to see this discussed in DLMs as the denoising budget increases.
-
The paper proposes a simple, intuitive yet effective method to adaptively decide whether to invoke a fixed high budget.
Critical weaknesses
-
I think the paper could benefit from some discussion of other related work on adaptive DLM inference (e.g., Prophet [1] and PG-DLM(adapt) [2]), as these methods also adaptively decide inference computation based on reward or confidence signals derived from the current or completed generation. More importantly, I would love to see some matched comparisons on the same evaluation subset, decoding configuration, output length, and total compute, etc.
-
As the authors acknowledge, the failure regime varies across model-task pairs, and the latency benefit depends on how often verification permits early termination. Therefore, the observed performance gain may be highly dependent on the current selected model/task pair.
[1] Li, Pengxiang, et al. "Diffusion language model knows the answer before it decodes." The Fourteenth International Conference on Learning Representations. 2026.
[2] Dang, Meihua, et al. "Inference-Time Scaling of Diffusion Language Models via Trajectory Refinement." arXiv preprint arXiv:2507.08390 (2025).
Questions for authors
-
Table 4 already shows that Self-Verification is much weaker at error identification. How would the end-to-end results change with smaller or weaker verifier models? Does the reported gain come from a general allocation strategy, or more from having a stronger model as the verifier?
-
Would the method be applicable to tasks where there is no capable independent verifier?
-
What is the value of using DLM when direct generation with Qwen2.5-7B-Instruct will have higher single-sample correctness 69.1% compared with the reported 48.0%? Some discussion of the end-to-end latency, throughput, compute, and memory differences would be helpful to justify the accuracy gap.