- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper examines the sequence-level power distribution , separating properties of this target from the behavior of approximate samplers. It uses rejection sampling when an argmax completion can be certified, together with importance sampling and differently initialized Metropolis–Hastings chains. Across mathematical and code-generation benchmarks, the paper finds that sharpening often favors short, high-probability completions and questions whether power sharpening explains RLVR-like improvements.
Critical strengths
-
Separating the target distribution from the sampling algorithm is an important and well-motivated question. An approximate sampler’s benchmark gains do not by themselves establish that the target distribution has the same benefit.
-
The combination of accuracy, completion-length analysis, and initialization comparisons provides useful evidence about how global sharpening and finite-run inference can behave differently.
Critical weaknesses
-
The empirical exactness claim needs stronger validation. Appendix K.1 explicitly reports that, for the example used in Figure 4, an accepted proposal’s saved log probability exceeds the saved argmax bound. A valid rejection envelope is central to the exact-sampling argument. This does not establish that the main results are wrong, but the paper needs to quantify the frequency and magnitude of such violations and demonstrate that the conclusions survive a consistent scoring and certification procedure.
-
The evidence has different coverage across methods. Rejection sampling is evaluated only on problems with a certificate and an accepted proposal, whereas other methods use the full benchmarks. Importance sampling and finite-run MH provide additional evidence, but not the same guarantee as valid rejection sampling. Consequently, the conclusion that earlier improvements arise from inference artifacts, and the broader interpretation concerning RLVR, are stronger than the certified subset alone establishes.
Questions for authors
-
How many problems exhibit proposal scores exceeding their certified bounds, and how do the main results change after excluding or correctly recertifying these cases?
-
Can you report paired comparisons of all methods on the same validly certified subset, alongside separate results and reliability diagnostics for the remaining problems?
2 comments
Following up with reviewer EEdm
We greatly appreciate reviewer EEdm volunteering their time to review our paper. We are following up to kindly request that the reviewer please let us know of any additional questions they may have before the review period deadline (November 18 AoE). We believe our paper greatly benefited from your comments and that we have addressed your concerns with our response above.
Response to EEdm
We appreciate the reviewer’s especially careful and thorough review of the paper. Your review motivated new analyses, which we have added to the revised text, that we believe has strengthened the quality of the work. We address your questions and concerns below.