- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
ZENO is a training-free decoder for masked diffusion language models. It first allows generation only near the start of a response, then expands this region geometrically and can switch to fixed-size increments. Tokens are filled according to confidence. Tests on LLaDA and Dream show faster decoding, with the largest quality gains on instruction-tuned reasoning tasks. Gains on base models and knowledge tasks are less consistent.
Critical strengths
- ZENO offers useful speed and accuracy trade-offs against adaptive samplers. On Dream Instruct, ZENO(NB)+C achieves 60.2% mean accuracy at 2.8 seconds per query, compared with KLASS at 59.9% and 4.4 seconds.
- The evaluation covers varied tasks and reports both gains and regressions. The experiments cover four checkpoints and six benchmarks, with parameter sweeps, five-seed stochastic tests and paired correctness analyses against vanilla decoding. The paper also reports knowledge-task regressions and the accuracy cost of approximate KV caching.
Critical weaknesses
- The methodological novelty is incremental. Fast-dLLM already combines fixed-block decoding, confidence-based token selection, early block completion and optional KV reuse. ZENO's main addition is a geometrically expanding prefix, optionally followed by fixed increments. I view this as a scheduling extension of existing block decoders. The 'AR-to-diffusion paradigm switch' framing in Section 1 overstates this change.
- The experiments do not show how much this new schedule adds. In Tables 1 and 2, Block uses 256 model evaluations, while ZENO also changes token selection and stopping. Tables 9 and 10 vary ZENO's parameters, but do not compare fixed-size and expanding regions under the same decoding rules. A direct comparison with the complete Fast-dLLM decoder is also missing. Table 4 applies its KV-cache mechanism to ZENO rather than evaluating Fast-dLLM itself as a baseline.
Questions for authors
- Could you compare fixed-size blocks and expanding regions using the same confidence threshold, per-step token limit and stopping rules? One representative Instruct setting would be sufficient.
- How does ZENO compare with the complete Fast-dLLM decoder in accuracy and per-query decoding latency under the same evaluation protocol and comparable caching configurations?
4 comments
A Gentle Reminder to review our responses
Dear reviewer,
Thank you again for your time and feedback on our submission. As the discussion period progresses, we wanted to send a gentle reminder regarding the response we’ve submitted. We have made a lot of effort to address the questions, and really feel that the questions that were asked are really valuable.
Your feedback is highly appreciated. Kindly let us know if you have any further queries.
Thanking you, The Authors
Thank you for your rebuttal, as well as for conducting the additional experiments. Your responses have satisfactorily addressed my concerns, and I have updated my review score accordingly.
Dear Reviewer,
Thank you for your positive feedback, for taking the time to evaluate our new experimental results, and for updating your score. We truly appreciate your questions and suggestions, which have significantly helped us strengthen our paper.
Thanking you, The Authors
We thank the reviewer for the feedback. As suggested, we have conducted the recommended experiments and addressed each point below to strengthen the paper.
Point 1. We acknowledge that ZENO shares components with Fast-dLLM (confidence-based token selection, early completion and optional KV reuse), and we have revised Section 1 to present ZENO as a change in decoding schedule. Our controlled ablations show that the schedule is not a minor detail. With all other decoding rules held fixed, geometric expansion matches or exceeds the accuracy of fixed-increment (linear) expansion with 12.6–21.3% fewer NFE (Point 2), and the full ZENO(NB)+C decoder matches Fast-dLLM's accuracy (53.3 vs 52.8 on LLaDA-Instruct; 60.2 vs 60.1 on Dream-Instruct) with 13.8% and 28.4% fewer NFE. The schedule also changes how the model generates: with left-anchored expansion, the answer is committed after 96–97% of the content is written, compared with 21–41% for vanilla (Fig. 13), and most of ZENO's accuracy gains come from improved content rather than answer completion. We therefore see the contribution as showing that the order in which a diffusion LLM commits tokens is an effective, low-cost lever for reasoning quality and we have framed it in these terms in the updated manuscript. [Revised: Introduction, L076–084; Contribution 1, L086–089; Appendix B.1, L816–822]
Point 2 + Q1 (fixed-size vs. expanding regions). Unlike Block in Tables 1–2 (256 NFE), this ablation changes only the region schedule and keeps every decoding rule identical to ZENO(NB): confidence threshold τ=0.8, per-step cap M=5, maximum generation length 256, and the same token selection, fallback, stopping and cleanup rules. With fixed-size causal blocks of 64 tokens, accuracy is 34.6 on LLaDA-Instruct and 26.2 on Dream-Instruct, compared with 54.2 and 61.6 for ZENO(NB) and stays essentially unchanged with M=64.
We also run a linear schedule that grows the window by a constant 8 tokens per phase (w.x+b with w=8;b=8, i.e. 16, 24, 32, ... tokens) until the generation limit is reached. On LLaDA Instruct, it scores 53.4 at 127 NFE, compared with 54.2 at 111 NFE for ZENO(NB). On Dream Instruct, it scores 61.2 at 138.5 NFE, compared with 61.6 at 109 NFE. ZENO matches or slightly exceeds its accuracy while using 12.6% and 21.3% fewer function evaluations, so the geometric schedule itself accounts for the efficiency gain. We have added this ablation to the revised version. [Revised: Table 12, Appendix F.9, L1226–1264]
Q2 (Fast-dLLM decoder evaluation). We evaluated the Fast-dLLM decoder as a standalone baseline, rather than only applying its KV cache to ZENO as in Table 4, under the same evaluation protocol on LLaDA-Instruct and Dream-Instruct (mean over six benchmarks), with τ=0.8 and without KV caching for both methods. Fast-dLLM scores 52.8 at 65 NFE, compared with 53.3 at 56 NFE for ZENO(NB)+C on LLaDA-Instruct, and 60.1 at 86.6 NFE compared with 60.2 at 62.0 NFE on Dream-Instruct. ZENO therefore matches or slightly exceeds Fast-dLLM's accuracy with 13.8% and 28.4% fewer function evaluations. We report NFE as the hardware-independent cost measure for this comparison; wall-clock timing for the Fast-dLLM run will be added in the final version. We have added all of these comparisons in the revised version of the submitted manuscript. [Revised: Table 12, Appendix F.9, L1266–1269; Section 5.1, L291–293]
We thank you for your thorough review and insightful comments on our work. We hope these additions address your concerns and would be grateful if you would consider them in your final assessment. Thank You!