- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies how to extract reusable skills from agent execution trajectories while reducing redundancy in external knowledge banks. The authors train a curator with GRPO using multiple reward signals, while keeping the executor frozen. Experiments show that the resulting knowledge banks improve task success rates and transfer to other executors.
Critical strengths
The paper addresses an important distinction between the usefulness of individual skills and the utility of an accumulated knowledge bank. Its reward design considers standalone utility, marginal gains over existing knowledge, and preservation of experience-specific information, providing a well-motivated approach to learning useful and complementary skills.
Critical weaknesses
The ablation lacks an SR + MSR baseline without MI feedback. Since MSR already rewards contributions beyond existing knowledge, this comparison is needed to establish the additional value of MI in the full framework. The current results show that MI improves over SR-only training, but do not isolate its contribution when marginal success feedback is already available.
Questions for authors
Could the authors report an SR + MSR baseline without MI feedback under the same training and evaluation protocol? This comparison would clarify the additional value of MI beyond marginal success feedback. Evidence of a meaningful improvement over this baseline could affect my assessment.
Thank the authors for your responses and the additional experimental results, which have addressed my main concerns. I have raised my rating accordingly.