- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
SkillsWiki organizes agent skills into a hierarchical taxonomy, a relation graph, and experience-grounded packages. Agents navigate category summaries and expand their skill sets through associated packages and relations. Experiments across three interactive environments and three backbone models report improved rewards, with component ablations supporting the usefulness of the proposed modules.
Critical strengths
SkillsWikii is practical and easy to follow. Linking composition strategies and failure guards to skills and surfacing them upon activation, provides a useful mechanism.
SkillsWikii shows improvements across multiple environments and models, provide encouraging evidence that the system’s benefits extend beyond a single model or task.
Critical weaknesses
Novelty is insufficiently. SkillNet already introduces the same three-layer architecture and automatic relation construction, and its later version includes Wiki-based exploratory skill selection. SkillWiki also studies continuously evolving skill infrastructurem, which is omitted in this paper.
Removing entire packages in the ablations does not distinguish the benefit of additional experience from that of the proposed association and activation mechanism.
Online efficiency is insufficient discuess. The paper doesn't compare retrieval latency, LLM calls, token consumption, or monetary cost. Exploratory retrieval may introduce additional inference overhead, so environment steps alone do not substantiate overall efficiency claims.
Questions for authors
With identical package content and reading budgets, does skill-triggered retrieval still outperform global experience retrieval?
Under the same skill library, model, and budget, what are each method’s online retrieval latency, token consumption, and end-to-end task cost?
We appreciate your valuable feedback and provide a detailed point-by-point response below.
We recognize the contributions of SkillNet and SkillWiki in this field. However, the framework we have proposed still has its own unique contributions:
Removing entire packages indeed cannot isolate the package activation mechanism. However, it needs to be clarified that skill packages are themselves designed for agents. They are used by agents to summarize experience from historical trajectories and to guide similar task execution. In the SkillsWiki retrieval mechanism, the roles of skill taxonomy, relations, and packages work coherently and are fully explored freely by the agent. Since the Wiki structure is an integrated whole, the agent's retrieval only involves the presence or absence of components, rather than non-existent sub-retrieval strategies.
We add a systematic comparison of online inference cost across all methods on MiniMax-m2.7, reporting input/output token consumption on ALFWorld, WebShop, and ScienceWorld (dev and test). The results show that SkillsWiki incurs substantially higher token usage than ReAct, ExpeL, and SkillNet, which we acknowledge as the cost of exploratory retrieval and discuss as a trade-off against its stronger task performance. However, with skill taxonomy, skill relations, and skill packages, SkillsWiki can indeed match better skill combinations, resulting in higher task rewards and fewer steps in most settings.