- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PGDD, a training-free decoding method that uses an answer-free vocabulary prior to guide token commitment order. The prior bank groups training queries and aggregates the model's initial predictions. At inference, the retrieved prior is combined with current confidence while retaining the model's original top-1 tokens. Experiments mainly use LLaDA-8B-Instruct on reasoning, code generation, and Countdown.
Critical strengths
-
The method is simple and easy to integrate. Prior retrieval requires no additional DLM forward pass at test time. The comparisons with frequency-based, linguistic, and unrelated-domain priors are useful for understanding what information the prior bank contributes.
-
The empirical results show useful complementary gains. On HumanEval with a 128-step budget, adaptive decoding improves from 26.22 to 29.27 while average steps decrease from 60.0 to 47.5. The combinations with Prophet, AHD, and Fast-dLLM further support its compatibility with existing decoders.
Critical weaknesses
-
The theory and the implemented decoder use different scoring rules. Theorem A.1 analyzes a multiplicative prior-weighted score, while PGDD uses an additive score evaluated at the model's original top-1 token. These rules can rank positions differently. The theorem provides motivation, but its connection to the practical decoding rule remains incomplete.
-
The uniform-prior control has an unexplained discrepancy. Under fixed-step decoding, a uniform prior should preserve confidence ordering apart from numerical or tie-handling effects. However, Table 8 reports HumanEval changing from 26.83 to 26.22. This is a small difference, but it needs clarification when many reported gains are around one percentage point.
Questions for authors
N/A
We sincerely thank the reviewer for these careful observations. Both concerns are valid, and we appreciate the opportunity to clarify them.
Q1. Relationship between Theorem A.1 and the implemented decoder.
We thank the reviewer for this observation. As discussed in the paper, Theorem A.1 is intended to provide theoretical motivation for prior-guided token prioritization, rather than a direct guarantee for the exact scoring rule used in PGDD.
As described in the abstract and the main text, the theorem studies an idealized setting with a multiplicative prior-weighted score, showing how prior information can help identify influential token positions. In practice, PGDD uses an additive combination of prior weight and model confidence, evaluated at the model's original top-1 prediction. This allows us to incorporate prior information into the commitment order without changing the model's predicted tokens.
We agree that the two scoring rules are not mathematically equivalent and may produce different rankings. The theoretical result supports the motivation for prior-guided decoding, while the effectiveness of the practical scoring rule is evaluated empirically. We will make this distinction clearer in the revised paper.
Q2. Uniform-prior control discrepancy.
We thank the reviewer for identifying this inconsistency. After reviewing our original experiment logs, we found that the initial HumanEval baseline was evaluated with
batch_size=4, while the uniform-prior control and all other experiments usedbatch_size=1.Different batch sizes can introduce small numerical differences during inference, potentially affecting confidence-based token commitment. This explains a possible source of the reported discrepancy. HumanEval contains 164 problems, and the reported accuracies of 26.83% and 26.22% correspond to 44 and 43 correct solutions, respectively. We further checked the per-problem results and confirmed that only one HumanEval test case differed between the two runs.
We have also rechecked the other reported results and confirmed their correctness. We will correct the HumanEval baseline comparison using consistent batch settings and clarify this detail in the revised paper.
We sincerely appreciate the reviewer's careful observation, which helped us identify this inconsistency in the experimental settings and improve the reliability of our evaluation.