- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the mismatch between evolving agent capabilities and relatively fixed training-time support in tool-use agent training, and proposes SEAL. Its core mechanism uses deterministic, verifier-grounded failure diagnosis to coordinate two adaptations: adjusting interface cues and recovery guidance for subsequent training rounds, and reweighting GRPO advantages for the current trajectories. The authors train on BFCL V3 and report improvements over matched Vanilla RL. The same trained checkpoints also exhibit positive transfer to the evaluated BFCL V4 and τ²-bench domains.
Critical strengths
-
A clear design that uses shared diagnosis to coordinate interaction support and policy optimization. SEAL uses the same verifier-grounded diagnosis to determine trajectory weights for the current policy update and select recovery guidance for subsequent training rounds. This offers a practical design for agent training systems that already have executable tool environments and verifiers.
-
The paper is generally easy to follow. The motivating example and overview figures provide an intuitive explanation of how verifier-grounded failure diagnosis connects learning-interface evolution with diagnosis-guided advantage reweighting. The distinction between training-time interface adaptation and evaluation under the original interface is also clearly communicated.
Critical weaknesses
-
The ablations do not fully disentangle the contributions of the components added to Vanilla RL. Appendix H.1 specifies that “Uniform” assigns a weight of 1.5 to verifier failures and 1.0 to successes, rather than assigning a weight of 1.0 to every trajectory. All four factorial conditions also share the base schema affordances. These comparisons do not fully isolate the contributions of static interface enrichment, outcome-dependent weighting, and diagnosis-aware optimization to the overall improvement over Vanilla RL. Additional controls would make this attribution clearer.
-
The trained backbones are relatively dated, leaving the applicability to more recent models uncertain. Given recent progress in open-source models for tool use in ReAct-style agents, I would like to see whether SEAL remains effective on more recent backbones of comparable scale, such as Qwen3.5-4B and Qwen3.5-9B.
Questions for authors
Please address the concerns raised in the Critical Weaknesses section above. In addition:
- Implementation of the diagnostic rules. Section 3.2 describes as a deterministic classifier over executable traces, applied in a fixed priority order, and Appendix F clarifies that labels are not determined simply by keywords in error messages. Could you provide more detail about how parser checks, schema validation, execution errors, state transitions, and verifier comparisons are mapped to the operational diagnosis labels? Do this process rely on keyword or pattern matching over error messages?
- Selection and sensitivity of the base utilities. How were the base utilities in Table 1 selected? Were they chosen heuristically or tuned empirically on the development set? How sensitive is SEAL to their numerical values and relative ordering?
- More comprehensive cost comparisons. Could you provide a more detailed cost comparison? Does SEAL retain its advantage over Vanilla RL when the total training compute budget is matched?
A kind reminder of the upcoming end of the discussion period
Dear Reviewer 3GKA,
Thank you again for your thoughtful review. We would like to kindly follow up on our earlier rebuttal, particularly the additional evidence addressing your central concerns about diagnosis-coupled co-evolution.
We have provided three new analyses directly relevant to W1:
We believe these results substantially strengthen the evidence for SEAL's effectiveness and the complementarity of its two adaptive components.
We would greatly appreciate your thoughts on whether these additional findings address your main concerns. We would also be grateful if you could reconsider your assessment in light of the new evidence.
Thank you for your time and consideration.