- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work investigates the efficiency and effectiveness of tool use in LLM agents, focusing on two issues: over-fusion and under-fusion. Over-fusion occurs when an agent combines tool operations without respecting observation dependencies, potentially leading to incorrect behavior. In contrast, under-fusion occurs when an agent executes independent operations in separate steps, resulting in unnecessary tool calls and increased costs. To address these issues, the authors propose ODFuse, a prompt-based extension of CodeAct that introduces a two-phase tool-calling strategy. The first phase selects operations that can be executed together based on their observation dependencies, while the second phase determines which intermediate results need to be observed before subsequent execution steps. Experimental results on AppWorld and MCP-Universe demonstrate the effectiveness of the proposed method in reducing execution steps and costs while maintaining competitive task performance.
Critical strengths
- Interesting research problem. The paper addresses the over-fusion and under-fusion issues in tool calling, which are interesting and relevant to the development of LLM agents. Properly organizing tool invocations is important for improving both the effectiveness and efficiency of agent execution.
- Promising experimental results. The experimental results on two benchmarks, AppWorld and MCP-Universe, provide strong empirical support for the effectiveness of the proposed method. Compared with the baselines, the proposed approach generally achieves competitive or better task performance while reducing execution costs.
Critical weaknesses
-
Limited generalizability of the identified issues. Although the identified problems are interesting, the current findings are primarily based on relatively older models, such as Gemini 2.5 and GPT-5. It remains unclear whether these issues are equally prevalent in more recent models, particularly those that have undergone specialized post-training for tool use. Additionally, both evaluated benchmarks involve tool-intensive tasks, which may limit the generalizability of the identified issues to other agentic scenarios.
-
Unclear distinction between the proposed method and reasoning-based improvements. The underlying idea of the two-phase prompting strategy appears to be a form of explicit reasoning guidance, which encourages the model to perform additional reasoning before executing tool calls. Therefore, the observed improvements may primarily result from enhanced reasoning and contextual understanding rather than the proposed two-phase prompting mechanism itself. Given that reasoning capabilities are already widely incorporated into modern agent designs, this raises concerns about the novelty and practical applicability of the proposed approach.
Questions for authors
- Are the identified over-fusion and under-fusion issues still prevalent in more recent LLMs, particularly when using their native tool-calling interfaces and templates?
- What is the impact of reasoning on the identified issues and the proposed method? For example, would enabling reasoning with a low reasoning effort produce similar improvements? Does ODFuse remain effective when applied to agents with explicit reasoning capabilities?
- To what extent do the findings generalize to other agent benchmarks, such as ALFWorld or ClawMark, which may involve different tool-use patterns and task characteristics?