- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SWD, a training-free decoding rule that combines a base token score with an exponential penalty on temporal KL divergence. An information-theoretic result under ground-truth context revelation motivates the method. Experiments on LLaDA and Dream cover several scoring metrics, full-sequence and block-wise decoding, additional tasks, and the latency and memory overhead of the stability calculation.
Critical strengths
-
The method is simple and has useful supporting experiments. The approximately NFE-matched comparisons retain substantial full-sequence quality gains, and the profiling study includes KL computation and memory overhead. The training-set validation protocol also gives a concrete way to select the penalty.
-
The analysis is reasonably broad. The paper studies selection policies, block sizes, KL direction, and longer history. It also distinguishes prediction changes from reference-answer errors and separates the idealized theoretical result from the practical model-based signal.
Critical weaknesses
-
The entropy scoring rule is unclear. Section 3.3 requires a nonnegative utility, but the detailed tables use negative entropy and negative thresholds. Multiplying a negative score by the proposed penalty raises it toward zero as KL increases, reversing the intended effect under largest-score selection. The exact transformation and threshold conversion are therefore important for interpreting and reproducing these results.
-
The strongest gains come from full-sequence decoding, while the block-wise results are more mixed. Table 2 shows small average gains and a slight decrease for Margin. With the validation-selected Dream Block-32 penalty, Confidence accuracy decreases on HumanEval, GSM8K, and MATH500. The ordinary LLaDA Block-32 baseline also exceeds full-sequence SWD Confidence on these tasks at lower NFE, limiting the practical scope of the broad robustness claims.
Questions for authors
N/A