- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes FOCUS, which selectively branches from compacted contexts to improve value estimation and credit assignment for long-horizon language-model agents. Experiments on legal reasoning, deep search, and code localization show promising performance gains. The approach has practical value, but the ablations do not sufficiently isolate the contribution of active sampling. Differences in experimental configurations and unclear checkpoint selection also require clarification, leaving the central claims insufficiently supported by the current evidence.
Critical strengths
1.The method addresses a practical challenge in long-horizon agent training. Using compacted contexts as branching points and credit-assignment boundaries provides a coherent connection between context management, value estimation, and policy optimization.
2.The results across multiple tasks are promising. Experiments cover legal reasoning, deep search, and code localization. With the 9B model, FOCUS improves over the strongest baseline by 7.2 percentage points on BrowseComp-Plus and 4.1 points on DeonticBench.
3.The paper investigates intermediate mechanisms. Beyond final performance, it examines value-estimation error, critic ranking quality, and alternative compaction strategies, providing useful evidence about the method’s behavior.
Critical weaknesses
1.The benefit of active allocation is not isolated. A controlled comparison against random or uniform branching is missing.
2.Experimental comparisons are confounded. LocBench uses different harness settings across methods, and computational costs are incompletely reported.
3.Evaluation reliability is unclear. Checkpoint selection needs clarification, and repeated runs or uncertainty estimates are missing.
Questions for authors
1.Does active allocation outperform random or uniform branching when the critic, advantage estimator, harness, and rollout budget are held fixed?
2.Were the BrowseComp-Plus checkpoints selected using the validation split or the held-out test split? If the latter, does the reported improvement persist with validation-based selection?
We thank the reviewer for their useful comments. We have submitted a revised manuscript with additional experiments and analyses, clearer organization, and improved presentation. We highlighted additional experiments and results in purple. Below, we address your specific questions and refers back to corresponding changes in the revised manuscript.
Active-allocation Ablation (W1, Q1)
We thank the reviewer for this suggestion. We provide further ablation against a random branching + TRACE (Zou et al., 2026) branching in section 3.4 of the updated version. For TRACE, we use the Uniform STAGE 1 and Active STAGE 2 configuration of TRACE paired with our training loss, which corresponds to the reviewer’s requested same budget, same value fusion, same advantage estimator comparison. We attach the ablation result below. On DeonticBench, we show that random got 52.7 and TRACE got 55.9, vs 56.5% by FOCUS. This suggests that actively allocating a rollout budget is contributing to the effectiveness of FOCUS.
A further discussion of the connection between TRACE and FOCUS is presented in the new Appendix I.
Matching Harness for LocBench Experiments (W2)
We thank the reviewer for pointing this out. The mismatch is due to our failure to migrate configurations during an internal harness upgrade. We have now included a matched FOCUS run and used that as our main LocBench result in table 1. FOCUS now shows performance at matched harness configurations. We also keep the original Harness with longer compaction length as an ablation over compaction threshold and the performance seems close, which we included below.
Our updated Figure 4(D) now plots evals for both harness configurations throughout training, and they track each other closely. This suggests that FOCUS is not overly sensitive to the choice of segmentation window.
BrowseComp-Plus Checkpoint Selection (W3, Q2)
For each method, we select the checkpoint with the 83-task validation split and report its accuracy on the 249-task held-out test split. We have clarified our language describing the process.
Uncertainty Estimates Over Results (W3)
We thank the reviewer for asking this question. We include paired-bootstrap CI over FOCUS’ differences against the strongest baseline in the group in this updated submission. For convenience, we also extract the paired CI for each results below.
References
[1] TRACE: A Unified Rollout Budget Allocation Framework for Efficient Agentic Reinforcement Learning (Zou et al., EMNLP 2026)