- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
ProbeCascade combines candidate-answer verification with a learned checkpoint Value signal for early stopping in long reasoning trajectories. Local answer agreement and uncertainty trends determine eligible checkpoints. A calibrated correctness model and a predictor trained from unfinished suffix lengths then define a stopping score. The experiments measure net token savings after charging forced-answer probes, using question-level held-out evaluation on three model–task settings.
Critical strengths
- The paper addresses a real distinction between answer stability and correctness.
- Charging issued probes is a meaningful part of the evaluation.
Critical weaknesses
- The evidence for the full Value component is weaker against the appropriate control than against No Value. Table 3 compares the full predictor with Token-step, which uses the same suffix target and Ridge training but only the two progress features.
- The comparison to prior stopping methods remains sensitive to the checkpoint protocol. LearnStop is explicitly adapted from fixed-budget checkpoints to sentence-level inspection (Section 4.2).
Questions for authors
- At preselected nominal budgets, what are the paired saving and accuracy differences between Full Value and Token-step, with uncertainty across held-out questions?
- Under the same net-cost accounting, how does LearnStop perform with its original checkpoint schedule?