- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents Adaptive Concentration–Exploration Power Sampling (ACE), a decoding method that adapts the sharpening strength alpha along the response generation trajectory for a problem instance. It frames power sampling as a trade-off between exploration and concentration, via low and high alpha in inference-time, and introduces a preservation-recovery decomposition of the overall accuracy performance to describe the behavior of a fixed power sampling relative to a high power sampling reference. The authors demonstrated that ACE could enable consistent directional evolution of values across problems of each task on the two classes of Qwen and Phi models used.
Critical strengths
- ACE adapts alpha at inference-time along fixed token lengths during generation, via alpha maximization constrained by a minimum effective sampling size on weighted particles.
- Similar to the power sampling methods TMC and SMC, the efficiency of ACE is better than MH. The efficiency of ACE is comparable to TMC and while being slightly worse than SMC.
- Excluding margins of error, ACE is competitive with or performs better than other power sampling methods when used on the Qwen models (it seems inconclusive for Phi models except for the averaged accuracy).
- ACE has another lever to adjust alpha; it counts the number of occurrences of token-level entropy exceeding a predefined level for potential additional alpha updates.
Critical weaknesses
- There seems to be no clear trend that demonstrates an optimal alpha for Qwen2.5-7B on HumanEval in Figure 1; that its accuracy is increasing and decreasing for a few cycles with increasing alpha seems to be counterintuitive. What is the standard deviation of the accuracy at each alpha?
- More rigorous baselines needed: As ACE is an adaptive method over alpha, it would be fairer to compare ACE to the baseline methods with their respective hyperparameters tuned to each model and task combination, i.e. temperature for temperature sampling and alpha for the other power sampling methods (instead of only using the recommended value of 4 for alpha in Table 1). Indeed, as shown in Figure 7, TMC produces higher accuracies when alpha is tuned away from the value of 4; and in Appendix D2, the ablation on tuning alpha is performed for only SMC on only a seed without the margins of error for discerning accuracies that are quite close to each other.
- Gap in the variety of tasks and evaluation metrics: The paper is quite narrowly focused on ACE vs other untuned power sampling methods on the accuracy metric. What is the effect of power sampling on other tasks such as creative writing, and on other qualities such as token diversity, especially when particle diversity is a core mention in the paper?
- Some inconclusive results: In Table 1, ACE is not conclusively better than the other baseline methods on the Phi models, and it seems MH is arguably stronger even without tuning its alpha. Having another model class would present more generalizable results than the two (Qwen and Phi) currently used. Considering the margins of error in Table 8, a number of the accuracies of ACE are unlikely to be statistically significant.
- Fixing the diagnostic reference: L205 and L241 - Since the sharpening effect is measured using preservation-recovery relative to strong sharpening, using alpha=10 as the diagnostic reference is still arbitrary. As alpha increases, we expect stronger sharpening to the limit of a greedy behavior within this decoding regime as the fixed reference.
- There is no analysis of ACE generated examples; please provide analysis of positive and negative ACE examples on the used datasets to show when exploration and concentration is good or bad. There are also no discussions to connect the empirical alpha_t distribution with the tasks. Please also highlight positive ACE examples relative to negative examples of other power sampling methods, and vice versa, for a more complete analysis.
- As the method requires a number of hyperparameters, such as , , , block size B, , etc, what are the effects of altering critical hyperparameters like B?
- Provide clearer result for comparison: Table 1 to include the per model per task accuracy of ACE without the token-level entropy feature, so as to be fairer in comparison with the baseline methods?
Questions for authors
Please refer to questions, clarifications and feedback in weaknesses.
8 comments
5. Robustness to the Diagnostic Reference
We thank the reviewer for raising this concern. To examine whether our preservation–recovery findings depend on the choice of as the diagnostic reference, we conduct an additional experiment using a much stronger sharpening strength of as the reference.
We evaluate Qwen3-8B-Base and Phi-4-mini across MATH-500, GPQA-Diamond, and HumanEval, reporting averages over three random seeds. As shown in the new figure, preservation generally increases with , while recovery generally decreases, consistent with our original findings. Importantly, all evaluated values are now distinct from the reference, so neither trend is determined by the reference endpoint.
These results suggest that the observed preservation–recovery trade-off is not specific to choosing as the diagnostic reference. We have included this additional analysis in Appendix D.1 (Figure 11, p. 23).
6. Case Studies and Task-Dependent Sharpening Behavior
We thank the reviewer for this valuable suggestion. We have added a case study in Appendix D.8 (pp. 31–32) to illustrate how ACE's adaptive sharpening can affect the generated reasoning process.
In a MATH-500 problem involving rotational symmetry, ACE correctly obtains the answer , whereas SMC, TMC, and MH incorrectly account for reflectional symmetry and return . During generation, ACE dynamically adjusts its sharpening strength from to , with eight downward and three upward updates. This example illustrates how adaptive sharpening may help preserve alternative reasoning paths rather than prematurely concentrating on misleading solutions.
We further relate this behavior to the task-dependent sharpening trajectories in Figure 5 and Appendix D.6 (Figure 14). Across the evaluated models, generally increases on HumanEval, decreases on GPQA-Diamond, and remains relatively close to its initialization on MATH-500, indicating distinct adaptation patterns across reasoning tasks.
7. Sensitivity to Block Size
We thank the reviewer for suggesting additional hyperparameter sensitivity analyses. In addition to the studies on the ESS threshold and initial sharpening strength in Appendix D.5, we have conducted a new block-size ablation on Qwen3-8B-Base using HumanEval.
| Block Size | Accuracy (%) |
|---|---|
| 64 | 70.73 |
| 128 | 70.12 |
| 192 | 70.12 |
| 384 | 70.12 |
| 768 | 70.73 |
The accuracy varies by only 0.61 percentage points across the evaluated block sizes, suggesting that ACE is relatively insensitive to this hyperparameter in the tested setting. We have included these results in Appendix D.5 (Table 11, p. 29).
8. Effect of Entropy-Triggered Updates
We thank the reviewer for suggesting a more detailed comparison. We have added the per-model, per-benchmark accuracy of ACE without entropy-triggered updates in Appendix D.4 (Table 10, p. 27). This variant retains adaptive sharpening at regular block boundaries while disabling entropy-triggered updates. These results provide a more detailed assessment of the contribution of entropy-triggered updates to ACE.
Dear Reviewer ybKr,
Thank you again for your constructive feedback. We have carefully addressed your concerns point by point and provided additional clarifications and experimental results where appropriate. We would greatly appreciate any further feedback and look forward to your response and continued discussion.
Best regards, The Authors
We appreciate the reviewer's careful evaluation of our work and the constructive feedback for further improvement. Below, we address the concerns regarding the interpretation of our findings, baseline comparisons, experimental generalizability, diagnostic analysis, and hyperparameter sensitivity.
1. Interpretation of Figure 1 and Variability Across Sharpening Strengths
The purpose of Figure 1 is not to suggest that accuracy follows a smooth or unimodal relationship with α, but to illustrate that different reasoning tasks may favor different sharpening strengths even for the same model. The fluctuations observed on HumanEval are consistent with our broader finding that stronger sharpening does not necessarily improve performance.
We have provided additional standard-deviation analyses for preservation and recovery in Appendix D.1 (Figure 9, p. 22). We also clarify that the highlighted α values represent the best observed performance within the evaluated sweep, rather than statistically established unique optima.
2. Comparison with Tuned Baselines
We thank the reviewer for this suggestion. While tuning a fixed sharpening strength can improve performance, it requires an additional offline search over multiple α values for each model–benchmark pair and cannot account for instance-level variation during generation. In contrast, ACE automatically adapts α without requiring such a search.
In addition to the tuned SMC comparison in Appendix D.2 (Table 5, p. 24), we have added a tuned TMC comparison on Qwen3-8B-Base in Appendix D.2 (Table 6, p. 25). For each benchmark, the best fixed α is selected using seed 42 and evaluated on five independent seeds. ACE outperforms tuned TMC on all three benchmarks, achieving an average accuracy of 63.5%, compared with 62.4% for tuned TMC and 61.5% for default TMC (α=4). These results further support the effectiveness of adaptive sharpening without requiring costly offline hyperparameter searches.
3. Generalization to Creative Writing
We thank the reviewer for suggesting an evaluation beyond reasoning accuracy. We conduct an additional experiment on EQ-Bench Creative Writing v3, using Qwen3-8B-Base and 96 writing samples per method. We follow the official EQ-Bench Creative Writing v3 evaluation rubric, using DeepSeek-V4.1-Flash-1017 (deepseek-flash) as the LLM judge to assess writing quality on a 0–100 scale.
ACE achieves the highest writing score of 27.54, outperforming Standard by 5.17 points, SMC by 6.75 points, and TMC by 6.56 points. These results suggest that the benefits of adaptive sharpening may extend beyond tasks evaluated by exact-match accuracy to open-ended text generation. We have included this experiment in Appendix D.9 (Table 14, p. 33).
4. Generalization Across Model Families
We thank the reviewer for highlighting the need for broader model coverage. To further evaluate the generalizability of ACE beyond the Qwen and Phi model families, we conduct additional experiments on SmolLM3-3B, covering HumanEval, GPQA-Diamond, and MATH-500. All results are averaged over five independent random seeds.
ACE achieves the highest accuracy across all three benchmarks, outperforming SMC by 0.97, 4.34, and 0.40 percentage points on HumanEval, GPQA-Diamond, and MATH-500, respectively. Its average accuracy reaches 60.18%, compared with 58.28% for SMC and 57.55% for TMC. We have included these additional results in Appendix D.9 (Table 13, p. 32), providing further evidence that ACE's effectiveness is not limited to the Qwen and Phi model families.