- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces CoSkill, a framework that jointly trains a Reasoning Agent and a Meta-Skill Agent using a shared language model and a hierarchical skill library. The Reasoning Agent retrieves task-level and step-level guidance, while the Meta-Skill Agent edits step skills based on execution feedback. Proposed edits are evaluated by re-executing the same task, with the change in return providing feedback for the editor. Both roles are trained through GiGPO. Experiments on ALFWorld and WebShop examine task performance, learning efficiency, skill evolution, and generalization.
Critical strengths
-
CoSkill jointly trains task execution and skill editing using a shared language model. The hierarchical skill library provides both task-level and step-level guidance, allowing the Meta-Skill Agent to modify individual procedures based on execution feedback while the reasoning policy is updated through reinforcement learning.
-
The authors retain the editing and verification procedures when removing the Meta-Skill Agent’s RL objective, helping assess the contribution of learning to edit. Experiments with a frozen Reasoning Agent also show improvements, providing evidence that skill-editing training is useful even without updating the reasoning model.
-
The paper includes experiments on the skill hierarchy, joint-update frequency, verification attempts, and unseen task types. The case studies provide examples of how learned edits preserve task constraints and retain reusable procedures, offering additional evidence about the behavior of the Meta-Skill Agent.
Critical weaknesses
-
The initial skill library is generated by an external model, but the authors do not specify which model is used. Given the importance of this initialization, an analysis of skill quality, library size, and task coverage would help clarify how strongly the reported results depend on the initial library.
-
Figure 5 shows that, as training progresses, UPDATE accounts for 97–99% of the Meta-Skill Agent’s decisions, while the other operations are rarely selected. This makes it unclear whether the reported gains come from learning to choose appropriate editing operations or mainly from improving existing skill content. The current analysis does not sufficiently distinguish these two explanations.
-
CoSkill relies on a pre-built library to start online learning. Although INSERT can add new step skills, it requires an existing parent task skill. The authors do not evaluate CoSkill with an empty library or with initial skills generated by its own backbone. Its ability to start skill learning without externally prepared knowledge therefore remains unclear.
-
The experiments are limited to two relatively constrained benchmarks. Additional evaluation on more challenging tasks, such as coding, would strengthen the empirical evidence.
Questions for authors
- The generalization experiment considers held-out task types within the same environment. Would CoSkill remain effective under larger distribution shifts, such as tasks from a different environment or domain? How well would the learned skills and editing policy generalize to these settings?
- How sensitive is CoSkill to the quality of the initial skill library? If the initial skills contain errors or omit important procedures, can joint training effectively correct them, and how would this affect learning efficiency and final performance? A case study illustrating how CoSkill handles incorrect or incomplete initial skills would be helpful.
- Could the authors clarify whether the task-level skill content is also updated when a revised bundle is promoted? Appendix D describes step-level editing operations, whereas Figure 4 refers to an “Edited Task Skill.”
2 comments
Thanks for your comment.
Thank you for your comment. To address W4, we have added results on two additional benchmarks: TriviaQA (single-hop) and HotpotQA (multi-hop). These results demonstrate that Coskill yields consistent improvements across four diverse benchmarks: ALFWorld, WebShop, TriviaQA, and HotpotQA.
With the rebuttal deadline approaching, we unfortunately do not have sufficient time to evaluate additional benchmarks. We sincerely appreciate your suggestions, which have helped strengthen our work. Moving forward, we plan to extend Coskill to real-world applications, and we appreciate your continued interest in our work.
Thank you for the rebuttal and additional experiments. However, my concern regarding W4 remains. The new experiments do not sufficiently demonstrate generalization to more complex scenarios. Therefore, I will maintain my original rating of 2.