- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies how to choose among multiple reasoning trajectories at test time. It separates two decisions: which unfinished trajectory should receive more computation, and which completed trajectory should provide the final answer.
For continuation selection, the paper proposes the Support History Score (SHS), which tracks how candidate-answer support changes over time. For final answer selection, it proposes the Trajectory Outcome Score (TOS), based mainly on when hidden-state changes occur during the reasoning trajectory. The methods are evaluated on three reasoning models across AIME 2024 to 2026, Omni-64, and GPQA-Diamond.
Critical strengths
- The paper makes a useful distinction between continuation selection and final answer selection.
The separation between deciding which trajectory deserves more computation and deciding which completed trajectory should provide the final answer is clear and useful. SHS and TOS are designed around these two decisions, giving the framework a clear structure.
- The experimental design is solid.
The paper uses the same sampled trajectories across methods and includes several controlled comparisons. The history vs. endpoint experiment fixes the observation endpoint, score weights, trajectory pool, and continuation protocol, so the effect of using trajectory history is relatively well isolated. The additional controls for SHS screening and TOS ranking also strengthen the empirical analysis.
Critical weaknesses
- The benefit of support history is mainly demonstrated on AIME.
The matched history vs. endpoint comparison shows consistent gains across the three models, but the paper notes that these gains come from the AIME settings because the selected Omni-64 and GPQA configurations use only one measurement. The additional GPQA sensitivity analysis is mixed across observation points. This makes it difficult to tell how broadly the history component itself generalizes beyond AIME.
- The advantage of TOS over simpler terminal-selection signals is modest and model-dependent.
TOS improves over uniform selection, but its margin over the fixed geometric control is relatively small. On Phi, the shorter-trajectory baseline slightly outperforms TOS. Since Table 2 aggregates all datasets for each model, it is difficult to see when the temporal-centroid signal is actually useful.
Questions for authors
- Could the authors provide a broader matched comparison of support history and current-point scoring outside AIME?
The GPQA sensitivity result is useful, but the direction of the effect changes with the observation point. A small additional breakdown on Omni-64 or GPQA, across more than one model or observation point, would help clarify how robust the history effect is.
- Could the authors provide a per-dataset breakdown of TOS against the simpler terminal-selection controls?
In particular, results against the fixed geometric rule and the shorter-trajectory baseline would help show where the temporal-centroid signal provides a consistent benefit. If the gains are strongly model- or dataset-dependent, clarifying or narrowing the corresponding claim would also address this concern.