- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
SkillCard compiles procedural instructions and visual evidence into single-image skills, with editable sources revised from agent experience. Experiments show gains on VisualALFWorld and VisualWebShop, alongside lower skill-related inference token costs.
Critical strengths
- Separating editable sources from rendered cards is a practical design.
- SkillCard improves over SkillRL by 7.1/4.5 points on VisualALFWorld ID/OOD.
- Results across three backbones suggest the approach is broadly useful.
Critical weaknesses
- The main novelty appears to be single-image compilation. State-conditioned visual procedures and skill–policy co-evolution already exist, so the paper needs to establish what this representation adds through concrete experiments and clear position on how this work among those related prior efforts.
- The experiments do not show that compiling a skill into one image is responsible for the gains. Differences in instruction quality, selected evidence, or retrieval remain alternative explanations. (Section 3.3 acknowledges that the variants retain different content; Table 3 does not compare identical content across presentation formats.)
- The benefit of evolution, a central contribution, is not demonstrated separately from policy training and the initial skill bank. (Appendix A.5 explicitly notes the absence of fixed-bank training and local-patch-versus-full-rewrite controls.)
Questions for authors
Does SkillCard outperform an interleaved text-and-image version of exactly the same source,?
How much does updating the cards improve over training with the initial bank fixed?
Do local patches preserve useful knowledge better than full rewrites?
In the end, sincerely thank the reviewers and area chairs for taking time to review our paper and for the replies during the discussion. Your feedback helped us clarify our work and see where it could be improved. Regardless of the results, we are grateful for the time and care you devoted to our submission!