- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes Marginal-Aware Rescaling (MAR), a training-free decoding method that suppresses deep-tail candidates while preserving competition near the peak. It combines this proposal with Best-of-N sampling and length-normalized, elevated-temperature scoring. A sharpening-loss framework motivates separating candidate selection from proposal coverage. MAR-BoN improves MATH500 accuracy over MCMC Power Sampling on all four evaluated models, and the reported cost comparison favors MAR. Results on other tasks are more mixed. The main concerns are the justification for the quadratic transform, errors and insufficient assumptions in the theoretical analysis, and gaps in the baseline comparisons and external-verifier claim.
Critical strengths
-
The method addresses a useful problem: improving reasoning through inference-time sampling without additional training. MAR is straightforward to implement, adds work per decoding step, and supports batched autoregressive generation.
-
The MATH500 results are encouraging across all four evaluated models. Table 4 also reports substantially lower token and wall-clock costs than MCMC under its stated accounting. The proposal and scoring ablations in Table 3 help distinguish the contributions of the two components.
-
The distinction between score ranking and proposal coverage is a useful way to understand Best-of-N. The budget-scaling experiments support the argument that improving the candidate distribution can matter even when the selection rule is held fixed.
Critical weaknesses
-
Appendix B.4 motivates the quadratic transform, but its design requirements do not uniquely determine it. For max-shifted logits and , alternatives such as with also preserve ordering and compress peak gaps when , while expanding them when . The claim that the theory fixes the functional form is therefore too strong. Comparing a few alternative exponents would help justify the quadratic choice.
-
Several theoretical statements need correction. In Eq. (50), the derivative is . Increasing therefore moves the expected shifted logit away from the peak and widens the compression region, contrary to the discussion. For fixed non-degenerate logits, as , peak logits remain zero while non-peak transformed logits tend to . Eq. (28) also drops prefix-dependent normalizers: , where . Although the authors discuss local versus global normalization, the displayed sequence-level proportionality generally does not hold. Finally, the first-crossing assumption in Proposition B.11 does not exclude later crossings and is insufficient for the claimed unique maximum. The conditions supporting that conclusion should be explicit.
-
The paper includes Standard BoN and a temperature-proposal baseline with the repaired score, but does not compare MAR with representative truncation or adaptive sampling methods discussed in Related Work. Comparisons using the same candidate budget and scoring rule would better establish the benefit of this rescaling. The accuracy tables also lack uncertainty estimates, which matters for small differences such as the 1.2-percentage-point HumanEval deficits relative to MCMC on three models.
-
The introduction states that gains persist with external verifiers, but Appendix D evaluates consistency voting and joint log-likelihood. These experiments support robustness to alternative selection signals, not independent external verification. The claim should be narrowed unless additional verifier experiments are provided.
Questions for authors
-
Could the authors correct Eqs. (28) and (50), state sufficient assumptions for Proposition B.11, and clarify how these changes affect the theoretical conclusions about MAR and elevated-temperature scoring?
-
Could the external-verifier claim be supported with an independent verifier experiment, or revised to refer specifically to the alternative selection signals evaluated in Appendix D?