- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Adaptive Reasoning Threads (ART): a single LLM keeps a main thread as the persistent state of the overall solution and, when a local issue needs deeper work, unfolds it into a private extension that inherits the problem and the reasoning accumulated so far and returns only its conclusion. The behavior is acquired through supervised fine-tuning followed by outcome-based reinforcement learning with main-thread-centered optimization and ART completion shaping. On three competition-mathematics benchmarks with two model sizes, ART outperforms matched linear-CoT baselines, including longer-CoT controls with comparable total generation budgets, and the gains persist under ordinary CoT decoding.
Critical strengths
- The motivation is clear and the protocol is specified precisely; the distinction between a persistent main thread and temporary extensions is a natural framing of the problem.
- The controls are thorough: cross-evaluating training recipes and inference modes separates the effect of the interface from the learned behavior, and the longer-CoT control with a closely matched total generation budget together with the attention-interaction analysis excludes the "additional computation" explanation.
- The observation that the learned organization transfers to ordinary CoT decoding, with fewer correction markers, Wait markers and restarts, is a valuable result.
Critical weaknesses
- Sec. 3.4 states three differences from prior work — state inheritance, a persistent main thread, and main-thread-centered optimization — and the all-token GRPO ablation in Tab. 5 supports the third, but none of them is validated against the two closest methods. APR (Pan et al., 2025) already unfolds a child thread that returns only a summary, and Context-Folding (Sun et al., 2025) learns branching and returning with RL alone, its prompted agent already performing branch-and-fold without training; describing this line as taking a "structure-predefined" view, and citing each work in a single clause with no comparison, leaves the claimed difference asserted rather than shown.
- The reported effects are of the same order as the measurement uncertainty. The benchmarks are small, the sampling noise of mean@16 alone is comparable to the headline gains, and no confidence intervals or significance tests are given. Evidence also comes from one domain and one model family.
- All reported extension-use rates carry the shaping reward: under outcome-only optimization use collapses to 0.2% (Tab. 4), so the model's natural usage at a workable level, and the accuracy it would reach there, remain unobserved. The interaction in Tab. 2 is also unexplained: the Python tool adds about eight to eleven points under ART, while under CoT it is flat to slightly negative.
Questions for authors
Please refer to Weaknesses.