- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The submitted manuscript seems to be about test-time compute in diffusion language models (dLLMs). It studies the question if Best-of-N performance can be improved if instead of sampling multiple answers from the same dLLM and sampler (so by just varying the random seed), one varies the dLLM and/or the sampler across generations.
Critical strengths
/
Critical weaknesses
- The paper to me feels end-to-end AI generated. I tried to understand the abstract but got stuck there already. Why use fancy terms like "candidate sources" or "generator calls" where we have established terms for those concepts already ("samplers" and "NFEs")? Also in abstract they use terms such as "residual set", "gated escalation rule", "dVoting decoder" which are never introduced and I wouldn't say they are that commonly known that one could use them without properly introducing them first?
- Also concepts like Best-of-N and Pass@k seem to be crucial here since this is a test time compute paper? But they are never used?
- There is no background section where the notation and the setting would be slowly introduce to aid the reader. In Section 3 they jump straight into problem formulation where the reader is confused even more since they do not bother to connect their presentation to the common concepts in test-time compute literature...
- By default the paper seems to be using dVoting sampler from [1] . Why use such a "niche" sampler? Why not use something more standard such as Fast-dLLM or EB-sampler? Also dVoting is slow no, since it requires generating samples sequentially, one-by-one?
- I do not understand how results are presented in Figure 1 and Table 1. Why average across different budgets? Why not present Best-of-N/Pass@k curves for various N as is common in the test-time compute literature?
- Also for Table 1, why are Two Temperatures [2] and Fast-dLLM [3] baselines? These are samplers, so I thought this could be used within the proposed mechanism of sampling different generations from various samplers?
[1] Feng et al. DVOTING: Fast Voting for dLLMs. arXiv 2026
[2] Olausson et al. A Tale of Two Temperatures: Simple, Efficient, and Diverse Sampling from Diffusion Language Models. COLM 2026
[3] Wu et al. Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding. ICLR 2026
Questions for authors
See above