- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
SkillGraph proposes a visual multi-agent framework that jointly adapts agent-specific visual evidence and communication structures through evolving skills. It uses a Multimodal Graph Transformer to generate attention-guided image crops and predict query-dependent communication graphs, while a failure-driven Skill Bank updates agent instructions based on execution feedback. Experiments on four visual question-answering benchmarks with multiple VLM backbones and communication topologies report consistent accuracy improvements and reduced inference-time token consumption.
Critical strengths
- The paper presents a coherent framework that connects skill retrieval, agent-specific visual attention, adaptive communication topology, and failure-driven skill refinement. The integration allows agent capabilities and collaboration structures to adapt to different visual tasks.
Critical weaknesses
- The authors claim that MMGT jointly learns agent-specific visual attention and communication topology. However, its training objective directly optimizes only the graph sampling policy, without explicitly optimizing the quality of visual attention.
- The three main components of the proposed framework have relatively direct foundations in existing techniques. The proposed co-evolution mechanism mainly involves revising skill descriptions, re-encoding skill embeddings, and alternating MMGT optimization. It does not introduce a dedicated objective or learning algorithm for jointly optimizing skills and communication topology, which limits its methodological novelty.
- Although the authors propose Skill–Collaboration Co-Evolution, the Skill Designer only modifies the trigger conditions and reasoning strategies of existing skills or creates new skills. It does not explicitly optimize the communication relationships among agents.
Questions for authors
- The proposed framework alternates between MMGT optimization using the current Skill Bank and skill refinement based on execution failures. Could the authors compare this approach with independently optimizing the Skill Bank and MMGT, followed by combining them at inference time? Such a comparison would help demonstrate whether the proposed co-evolution mechanism is necessary.
- SkillGraph provides agents with additional attention-guided image crops, so the performance improvements may result from access to higher-resolution local visual evidence rather than the proposed skill-conditioned selective attention. Could the authors compare against random crops or uniform grid crops under the same visual token budget to verify the effectiveness of the learned attention mechanism?
- The reported inference efficiency improvements may primarily result from reducing the number of communication edges rather than learning a more effective communication topology. Could the authors provide additional ablation experiments comparing learned communication graphs with random or heuristic graphs under the same communication edge budget?