- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces SIAR, a skill-augmented agentic reinforcement learning framework that leverages step-level skill influence attribution to enable the co-evolution of skills and agent policies. By quantifying how strongly retrieved skills drive individual actions through log probability comparisons, SIAR guides skill updates only when accumulated evidence indicates a mismatch with task outcomes and calibrates advantage assignment to provide targeted credit or penalties for highly influenced steps. Experiments on ALFWorld, WebShop, and search-augmented QA benchmarks demonstrate that this approach significantly outperforms existing methods by effectively aligning policy optimization with fine-grained skill influence signals.
Critical strengths
- The writing is well-presented.
- The motivation is well-justified.
Critical weaknesses
-
Please explain how the current implementation controls for positional embedding shifts when computing . Did you use padding or other alignment techniques? I suggest adding an additional set of experiments to demonstrate that this does not affect the final results.
-
I suggest discussing the sensitivity of the performance to the threshold . Specifically, address how the method handles scenarios where failed trajectories are scarce (leading to skill stagnation). In later training stages where failures are rare, does this lead to skill stagnation?
Questions for authors
Please refer to "Critical Weaknesses".