- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies how update width (the number of token positions resampled per correction call) affects the performance gap between different correction call placements in uniform discrete diffusion language models. Using an existing corrector with a fixed predictor grid and call budget, it finds that wider updates reduce the advantage of terminal refinement (all corrections after prediction finishes) over late-interleaved correction, as measured by GPT-2-large generative perplexity on OpenWebText and One Billion Word Benchmark (LM1B). The paper also compares terminal refinement with calibrated nucleus sampling in a separate LM1B study at a single width (k=3), finding lower generative perplexity and latency for terminal refinement but higher prefix MAUVE for nucleus sampling.
Critical strengths
- Controlled design: All placement schedules share the predictor grid, call count, and corrector, and the OpenWebText direction was predicted from the LM1B results before the run.
- Transparent reporting: The paper documents all seed cohorts and reports unfavorable results, including higher prefix MAUVE for nucleus sampling and the unresolved LM1B baseline gap.
Critical weaknesses
-
Unclear presentation and motivation: Key terms are used before they are defined. For example. LM1B is never expanded, and OpenWebText and nucleus sampling are not cited. The motivation consists of a single question at the start of the introduction (“how that update width changes the benefit of finishing prediction first”), followed directly by results. The paper does not explain which existing placement comparisons fixed a single width, why width should be expected to change the comparison, or what a practitioner should do differently; its takeaway, a recommendation to report width, appears only in the conclusion. The nucleus comparison (4.4–4.5) is disconnected from the width question and is run only at k=3, although the paper’s own finding is that terminal refinement’s relative standing depends on width.
-
The evidence is narrower than the claims: Each schedule is evaluated at a single temperature, although GenPPL rankings can flip with small entropy differences (Pynadath et al., 2026). The paper’s own temperature sweep shows that small changes in entropy produce large changes in GenPPL, yet the compared schedules are not matched in entropy. Terminal refinement produces less diverse text than both late correction (at narrow width) and nucleus sampling, so part of its GenPPL advantage may simply come from lower diversity. Additionally, the authors’ run of the public LM1B checkpoint gives GenPPL 189, far from the published value of 80 (Schiff et al., 2025), for reasons they could not identify, and the paper does not discuss whether its relative findings would hold for a model matching the published quality.
References
Pynadath, P., Shi, J., and Zhang, R. Generative Frontiers: Why Evaluation Matters for Diffusion Language Models. arXiv:2604.02718, 2026.
Schiff, Y., Sahoo, S. S., Phung, H., Wang, G., Boshar, S., Dalla-Torre, H., de Almeida, B. P., Rush, A. M., Pierrot, T., and Kuleshov, V. Simple Guidance Mechanisms for Discrete Diffusion Models. In International Conference on Learning Representations (ICLR), 2025.
Questions for authors
- Could you report the width interaction and the terminal-vs-nucleus comparison at matched entropy, for example by sweeping temperature for each schedule? This would show how much of each effect remains once diversity is controlled.
- Have you been able to obtain a checkpoint or sampling setup that reproduces the published LM1B GenPPL? If not, why should the relative placement results carry over to a model at the published quality?
- Why was the nucleus comparison run only at k = 3? Does terminal refinement still compare favorably with nucleus sampling at k = 12?