- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces Minimal Sufficient Skills (MSS), a deletion-first framework for evolving compact agent skills while preserving task behavior. MSS decomposes skills into dependent modules, proposes structured deletions and abstractions, and accepts edits using counterfactual validation, instance-dependence estimates, and Pareto selection. Experiments on four author-curated task groups report improved held-out performance, transfer robustness, and skill compression relative to several author-defined control baselines. However, the task suite and experimental details are not sufficiently specified for independent reproduction, and the paper does not directly compare MSS with existing skill-evolution systems discussed in the literature.
Critical strengths
- The paper presents a clear motivation for behavior-preserving skill compression. The deletion-first design and counterfactual checks are reasonably aligned with this objective.
- The experiments include several component ablations and transfer settings. These analyses provide some evidence that the proposed design choices affect the reported results.
Critical weaknesses
- Evaluation is restricted to an underspecified, author-curated dataset. The paper evaluates only on four internally constructed task groups and does not provide a sufficiently precise public specification of the instances, task-generation procedure, initial skills, verifiers, or data release. The main experimental section also does not clearly identify the backbone models and other experimental settings in a centralized, reproducible way. No results are reported on established public benchmarks such as SkillsBench, SpreadsheetBench, OfficeQA, or ALFWorld. This makes it difficult to reproduce the study and raises concerns that the chosen tasks, verifiers, and skill distributions may favor MSS or make the reported comparisons unfair.
- There is no direct comparison with the skill-evolution methods discussed in Related Work. The paper explicitly discusses SkillEvolver [1] and SkillRL [2], but neither method is included in Table 1. The reported baselines are mostly author-defined controls (random deletion, token penalty, LLM summarization, and a generic incremental-editing prompt), rather than reproductions of published systems. The paper should also consider representative recent works such as SkillOpt [3], Trace2Skill [4], and EvoSkill [5], using a common public benchmark and matched budgets. Without these comparisons, the claim that MSS improves over existing skill-evolution approaches is not supported.
Refs:
[1] SkillEvolver: Skill Learning as a Meta-Skill.
[2] SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning.
[3] SkillOpt: Executive Strategy for Self-Evolving Agent Skills.
[4] Distill Trajectory-Local Lessons into Transferable Agent Skills.
[5] EvoSkill: Automated Skill Discovery for Multi-Agent Systems.
Questions for authors
Please see weaknesses.