- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Sub-Planner, a training-free multimodal agent framework built to handle reasoning in specific fields. It works by teaming up a general-purpose MLLM (to plan, pick tools, and check facts) with specialized MLLMs (to solve the smaller tasks and put together the final answer).
By breaking down problems, using tools to gather evidence, and checking its work at multiple stages, the framework makes reasoning more reliable. Sub-Planner is tested on diverse tasks across different fields and it shows improvement against with original generalist model and specialist model. The paper also includes experiments to evaluate inference efficiency, key components, and other aspects.
Critical strengths
-
Extensive Testing. The authors evaluate the framework across 17 domains and 26 tasks, demonstrating the method’s performance and cross-domain stability. They also swap in different generalist backbones, proving the framework is flexible and not limited to a single model.
-
Supporting Ablations. The authors provide ablation experiments on the effects of the framework's components and its inference cost. These help us better understand the method.
Critical weaknesses
-
Limited Novelty. The framework mostly just pieces together existing ideas: using a general model to break down tasks and pick tools, relying on specialized models for answers, and adding a verification step. These concepts are already well-established in prior work like HuggingGPT [1], Chameleon [2], MultiMedRes [3], and MEXA [4]. Especially, the paper doesn't discuss these closely related works, it is hard to see what is actually new about the method. It appears to merely apply existing simple methods (plan, execute and verify pipeline) to the multi-domain task. That’s clearly insufficient to establish a convincing research contribution.
-
Unclear Baselines and Reproducibility Issues. The paper includes agent frameworks like ToolScope [5], MMCTAgent [6], and DART [7] in Table 1, but doesn't clearly explain how Sub-Planner differs from them. These methods are not even mentioned in the Related Work sections. Additionally, there aren't enough implementation details for the baselines. For example, methods like MAT [8], SPORT [9], and MARS [10] require training or fine-tuning. Did the authors retrain or adapt these methods to the unified backbone for all the tested domains? Without this information, it is hard to tell if the comparisons are fair or if the results can be reproduced.
-
Why emphasize multimodality repeatedly? The paper repeatedly highlights multimodal agents and MLLMs, but the actual method, breaking down tasks, using tools, and checking answers, doesn't introduce any features specific to multimodality. Even though the system is tested on multimodal benchmarks, the authors don't explain or show how handling different modalities actually makes the framework better. The repeated mentions of multimodality in the abstract, introduction, and related work sections, without explaining its advantages or demonstrating them experimentally, make this paper difficult to read and its argument unclear. This creates a noticeable gap between the paper's motivation and what the method actually does.
References
[1] Shen et al. (2023). HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Face. NeurIPS 2023. https://arxiv.org/abs/2303.17580
[2] Lu et al. (2023). Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models. NeurIPS 2023. https://arxiv.org/abs/2304.09842
[3] Gu et al. (2025). A Proactive Agent Collaborative Framework for Zero-Shot Multimodal Medical Reasoning (MultiMedRes). Advanced Intelligent Systems. https://doi.org/10.1002/aisy.202400840
[4] Yu et al. (2025). MEXA: Towards General Multimodal Reasoning with Dynamic Multi-Expert Aggregation. Findings of EMNLP 2025. https://aclanthology.org/2025.findings-emnlp.1233/
[5] Deng et al. (2026). ToolScope: An Agentic Framework for Vision-Guided and Long-Horizon Tool Use. Findings of ACL 2026. https://aclanthology.org/2026.findings-acl.11/
[6] Kumar et al. (2024). MMCTAgent: Multi-modal Critical Thinking Agent Framework for Complex Visual Reasoning. arXiv:2405.18358. https://arxiv.org/abs/2405.18358
[7] Sivakumaran et al. (2026). DART: Leveraging Multi-Agent Disagreement for Tool Recruitment in Multimodal Reasoning. EACL 2026. https://aclanthology.org/2026.eacl-long.253/
[8] Gao et al. (2025). Multi-Modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage (MAT). ICLR 2025 Workshop. https://arxiv.org/abs/2412.15606
[9] Li et al. (2025). Iterative Tool Usage Exploration for Multimodal Agents via Step-wise Preference Tuning (SPORT). NeurIPS 2025. https://proceedings.neurips.cc/paper_files/paper/2025/hash/55d16334943f8728073e17139e5baa3d-Abstract-Conference.html
[10] Yue et al. (2026). MARS: Multimodal Adaptive Reasoning Model for Avoiding Overthinking. AAAI 2026. https://doi.org/10.1609/aaai.v40i41.40753
Questions for authors
-
How were inference budgets, including token consumption and model/tool calls, controlled to ensure fair comparisons across methods? The proposed method appears to require more calls to MLLMs, so why does it show a shorter average inference time? (This question further highlights the issue 2 mentioned above)
-
Given that most evaluations involve static question-answering tasks in Table 1, what evidence supports the broader claims of generalist agent planning and cross-domain generalization?
-
Other questions are listed in
Critical Weaknesses