- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper re-examines permanent token freezing in masked diffusion language models. A committed token's identity no longer changes, but its keys and values can continue changing and affect predictions at other positions. The authors argue that monitoring the committed position's own posterior is poorly aligned with this outgoing influence, particularly when that posterior is saturated. They propose freezing every token after a fixed delay following commitment instead of using a token-specific convergence test.
Validation includes a softmax-saturation bound, measurements of token-wise non-contraction, shuffled-wait controls, comparisons with alternative signals, and accuracy-compute evaluations across five models. Two pre-specified held-out MATH-1500 comparisons report gains of 2.80 and 2.27 percentage points over the KL criterion at approximately matched work. A separate compacted executor realizes roughly 1.4x speedups at larger batch sizes using replayed schedules. The theoretical optimality result is restricted to uninformed schedules and a convex mean-exposure condition.
Critical strengths
-
A consequential diagnosis supported by targeted controls. Sections 4.1-4.3 distinguish the statistic being monitored from the representations that propagate freezing error. Saturation analysis, alternative signals, and shuffled waits provide complementary evidence. This supports acceptance because the paper explains a failure mode of an existing design choice rather than merely reporting a better threshold.
-
A simple replacement with held-out empirical support. Table 3 reports positive MATH-1500 differences with paired confidence intervals excluding zero, following development on a disjoint split. The broader model and schedule evaluations show that a fixed delay is a useful competitive baseline. A substantially simpler policy with this evidence is a meaningful contribution even without general optimality.
Critical weaknesses
-
Runtime and accuracy do not come from the same live execution path. Appendix G explicitly states that timing replays freeze schedules and that no accuracy number comes from the compacted executor because numerical differences can alter decoding. The timing demonstrates achievable execution savings for those schedules, but does not establish that the accelerated implementation realizes the reported quality. This matters to the practical acceleration claim and could lower my assessment if live decoding loses the quality advantage.
-
Some superiority and quality-preservation language is stronger than the comparisons establish. The held-out delay arms use somewhat more computation than their criterion counterparts, and the main matching rule permits a three-point skipped-work gap. Table 15 reports no statistically separated differences under the alternative rule requiring the delay to skip at least as much work. Also, intervals containing zero after shuffling or across delay settings do not establish equivalence or non-inferiority. The evidence supports a competitive simple rule more strongly than a universal superiority or no-loss claim.
Questions for authors
-
Clarification: Are any complete generations evaluated with the compacted executor running the policy live? If available, please provide their accuracy, realized skipped work, and speed on the same questions. This would connect the practical speed claim to task quality.
-
Evidence needed for assessment: Can you quantify the held-out advantage at more closely matched work, and give a bound on the plausible accuracy loss for the claimed safe-delay range? The concern is whether the current intervals and budget differences support the strength of the conclusion, not a request to establish a new general theorem.
Dear reviewers,
The author-reviewer discussion period is ending soon. If you have not done so yet, please read the authors’ rebuttal and reply to it. Tell the authors whether it addresses your concerns, and update your score if your assessment has changed.
The ICLR 2027 Reviewer Guidelines list « discussing with the authors to clarify and improve the paper » as one of the core duties you accepted as a reviewer. With the high number of submissions this year, your input matters more than ever. Recall that reviewers that do not fulfill their duties may also face penalties on their own submissions.
Thank you for your time and help.
Best regards,
Your Area Chair