- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
SkillZip Pro studies how to compress the progressively loaded skill files to improve efficiency of applying the skills. It finds that shrinking the menu does not necessarily mean a lower cost, and overly deduplication may cause damage to sub-skill utilization. The method optimizes the context, shared location and loading structures at the same time. In the experiments, the method achieves SOTA performance in balancing the skill compression rate and the effectiveness maintained.
Critical strengths
- The targeted problem is practical and meaningful. As the skill can be updated often, reducing its size to improve efficiency and clarity is increasingly important and widely applicable.
- The proposed method successfully achieves a good balance between the compression ratio and the effectiveness.
- The experiments are thorough and cover multiple aspects of possible application scenarios and potential concerns about the method.
Critical weaknesses
- The experiments are too dense to understand fully. There are many experimental settings for each figure or table, making the reader hard to follow.
- The method is straightforward, making the contribution more centered on the engineering part. The proposed methods are more likely heuristic-based. Since this is a pro compared to SkillZip, providing a certain level of first-principles rules for compressing skills would be a major advance.
Questions for authors
Please refer to the weakness
I thank the authors for the detailed rebuttal and follow-up. Organizing the experiments around a few explicit questions makes the evaluation easier to follow, and the stated decision rules, together with the worked trace, clarify why each compression move is taken. I encourage including that worked example in the final version. However, these rules are local cost-benefit conditions derived from the paper's own cost model, and the audits mainly show that the compiler follows them. They therefore do not yet amount to general principles for compressing skills. Moreover, part of the deletion safety rests on a model-based entailment check, which the paper itself treats as auditable evidence rather than a formal guarantee, so the soundness claim in the response should be stated more cautiously. I will keep my current positive score.