- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
A BPE-like approach is used to synthesize a dataset from successful tool execution trajectories. CIPO is then employed to construct two trajectories and amplify the reward difference between them, enabling the model to better adaptively select between skills and atomic actions to address the adaptive tool granularity selection problem.
Critical strengths
1.The choice between atomic tools and skills is clearly modeled as an adaptive tool granularity selection problem. And a pipeline was constructed from data synthesis to the completion of training(CIPO).
2.The average TSR of CIPO increased from 29.30% of GRPO + Skills to 36.48%, and the average Tool F1 rose from 41.20 to 48.23. After removing the counterfactual bonus, the average TSR dropped to 31.65%, indicating that this reward component has a real contribution.
Critical weaknesses
1.The source of the success trajectory is not specified as being from a strong model or from the model itself. No information was provided regarding the specific success screening criteria adopted or the number of successful trajectories in each dataset.
2.The paper's training rewards and some evaluation metrics rely on reference tool trajectories or an LLM judge. Additionally, the paper lacks evaluations of actual inference latency and computational cost.
Questions for authors
1.Provide more details on the construction of successful trajectories.
2.Provide execution-based evaluations beyond TOOLATHLON and report actual inference latency, token consumption, and computational cost.
3 comments
Response to Reviewer mhbc (2/2)
W2 & Q2. Can CIPO demonstrate execution-based improvements beyond TOOLATHLON, and what are its actual inference and training costs?
1. Evaluation reliability and existing execution-based evidence.
We acknowledge that CIPO's training reward uses reference-tool coverage (Appendix E). However, the evaluation also examines task completion beyond reference-based reward optimization.
| Evaluation | GRPO + Skills | CIPO | Improvement |
|---|---|---|---|
| Strict yes-only success (%) | 21.40 | 27.68 | +6.28 pp |
| TOOLATHLON execution success (%) | 17.67 | 25.17 | +7.50 pp |
The strict evaluation excludes partial completion but still uses an LLM judge. More importantly, TOOLATHLON's official evaluator verifies the final environment state independently of reference-trajectory matching and LLM judgments, showing a 7.50-percentage-point improvement for CIPO.
2. Additional evaluation on TRAJECT-Bench and TOUCAN.
For consistent cross-benchmark comparison, our main experiments adopt a unified TSR protocol. We additionally evaluate TRAJECT-Bench using its native Solution Accuracy metric, which judges final-answer correctness against ground-truth solutions, rather than including partial trajectory completion.
For TOUCAN, no equivalent official task-state evaluator is available. We therefore supplement TSR with Reference-Chain Exact Match, comparing the expanded atomic tool sequence against the annotated target sequence after tool-name normalization.
Both additional comparisons use Qwen2.5-7B and the same 100 evaluation episodes per benchmark.
Additional Benchmark-Specific Evaluation :
| Benchmark / Metric | GRPO + Skills | CIPO |
|---|---|---|
| TRAJECT-Bench / Solution Accuracy (%) ↑ | 19.00 | 25.00 |
| TOUCAN / Reference-Chain Exact Match (%) ↑ | 14.00 | 21.00 |
These metrics complement the main TSR results by examining final-answer accuracy and strict reference-tool agreement, respectively. Meanwhile, TOOLATHLON's environment-based evaluation provides independent evidence of actual task completion without relying on reference-trajectory matching or LLM judgments.
3. Computational cost and inference efficiency.
We further compare training overhead and inference efficiency under matched hardware and evaluation settings.
Additional Efficiency Analysis:
| Method | Tokens/Episode ↓ | LLM Latency (s) ↓ | End-to-End (s) ↓ | RL GPU-h ↓ |
|---|---|---|---|---|
| GRPO + Skills | 3,410 | 18.6 | 33.4 | 84 |
| CIPO | 3,150 | 17.1 | 31.7 | 90 |
The comparison corresponds to 7.6% fewer generated tokens, 8.1% lower LLM latency, and 5.1% lower end-to-end latency, with 7.1% additional RL training GPU-hours.
Crucially, counterfactual branching is used only during training. At inference, CIPO directly selects atomic tools or composite skills without generating alternative continuations. Thus, the matched counterfactual mechanism does not introduce additional branch-generation overhead at deployment.
Overall, CIPO's improvements are supported by both strict task evaluation and independently verified execution outcomes on TOOLATHLON. The additional benchmark-specific metrics provide complementary evidence of solution quality, while the computational analysis characterizes the trade-off between training overhead and inference efficiency.
Thank you again for your constructive comments, which have helped us improve the clarity and completeness of our work. We hope our detailed responses and supplementary analyses have resolved your concerns, and we would greatly appreciate your reconsideration of the paper's rating.
Gentle Follow-up on Our Rebuttal Responses
Dear Reviewer mhbc,
We sincerely thank you again for your careful review and constructive feedback. We understand that this is a busy period, and we would be very grateful if you could take a moment to review our rebuttal responses.
We have provided additional analyses and clarifications addressing your main concerns, including the sources and screening criteria of successful trajectories, evaluation reliability beyond the main LLM-judged TSR, and computational costs and inference efficiency. We have also incorporated the corresponding clarifications and analyses into the revised manuscript, with changes highlighted in blue.
As the discussion period draws to a close, we would greatly appreciate any further feedback you may have. If any questions or concerns remain, we would be more than happy to address them.
Thank you again for your time and thoughtful consideration.
Best regards,
The Authors
Response to Reviewer mhbc (1/2)
We sincerely thank the reviewer for the constructive feedback and for recognizing CIPO's adaptive granularity formulation and counterfactual optimization design. We appreciate the concerns regarding data provenance, evaluation reliability, and computational efficiency, and address them below.
CIPO constructs its skill library from the publicly released trajectories of the three original benchmarks, without collecting additional trajectories from a separate teacher model.
Specifically, we use TOOLATHLON (https://arxiv.org/abs/2510.25726), TOUCAN (https://arxiv.org/abs/2510.01179), and TRAJECT-Bench (https://arxiv.org/abs/2510.04550). All three processed datasets contain a binary
successfield, and we retain trajectories satisfyingsuccess == 1. Importantly, the underlying success criteria differ across benchmarks:The
successlabels follow dataset-specific criteria: TOOLATHLON requires both task completion and a positive result from its official evaluator (task_status.running == 'done'andtask_status.evaluation == True); TRAJECT-Bench requires all tool calls in the trajectory to execute successfully (num_tools_used == num_successful_tools); and TOUCAN requires the selected tools to match the annotated target tools. These criteria capture different aspects of tool-use correctness and are used to select positive trajectories for skill discovery within each dataset.As detailed in Section 3.2 and Appendix A, we subsequently exclude sequences shorter than two tool calls and abstract task-specific argument values to identify reusable tool patterns. Budget-constrained BPE then extracts a compact set of candidate skills.
These trajectories provide reusable tool sequences, while CIPO independently learns when invoking a composite skill is preferable to retaining atomic control.
We have expanded Appendix K to clarify these dataset-specific screening criteria and trajectory statistics.