- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
ToolHallu addresses hallucinations in language model agents’ tool calls, including incorrect tool selection, invalid parameters, and repeated calls. It adds fine-grained rewards for these errors to a reinforcement learning framework. A curriculum schedule shifts the reward emphasis from selecting the correct tool to generating accurate parameters. Experiments on API-Bank and StableToolBench show lower overall tool-call hallucination rates across the evaluated models, with accuracy gains in many settings. The evaluation does not execute real APIs, so its results do not establish improvements in end-to-end task completion.
Critical strengths
1.A clearly defined problem. The paper distinguishes incorrect tool selection, parameter errors, and repeated calls, making failures easier to diagnose than evaluating final answers alone.
2.Targeted reward signals. It scores errors such as invoking nonexistent tools and using incorrect parameter types separately, providing direct guidance for improving tool calls.
Critical weaknesses
1.No actual tool execution. The results mainly show that generated calls satisfy the evaluation criteria; they do not establish success in a real API environment.
2.Task accuracy may be overstated. On StableToolBench, a reasonable first step can receive full credit even if the task remains incomplete.
3.Accuracy drops substantially in some subsets. For example, on StableToolBench G2 with Qwen3 0.6B, accuracy falls from 0.58 with GRPO to 0.36 with the proposed method.
Questions for authors
1.Could you add multi-turn experiments with actual API execution? Do the reported gains translate into higher end-to-end task completion rates?
2.How many tool calls does each method make on average, and how often does it decline to call a tool? Could part of the lower hallucination rate result from making fewer calls?
We would like to express our gratitude for your valuable suggestions!
We initially align our tool-call evaluation with [1, 2] using LLM-as-a-judge. We conducted additional experiments such as BFCL's multi-turn tasks, ACE-Bench, and Tau-Bench, which use interactive API simulators. Table 1, 2 and 3 reveal that our method consistently reduces the hallucination rate.
Table 1. The multi-turn results evaluated on BFCL.
Table 2. The results evaluated on ACE-Bench with Qwen3-0.6B.
Table 3. The results evaluated on Tau-Bench with Llama-3.2-3B-Insturct.
We first align our evaluation protocol with API-Bank for evaluation efficiency and convenience. Since errors and failures at a given step accumulate across multi-turn interactions, localized issues (at a specific step) can reflect overall performance. Furthermore, because all methods are evaluated under this identical framework, the comparison remains fair.
We also conduct experiments running the full process on StableToolBench to see the performance. Our method still outperforms others.
Table 4. The full turn results evaluated on Qwen3-0.6B.
We inadvertently misaligned the table entries, impacting four table cells. After correcting this, the updated results generally outperform the GRPO baseline. The overall accuracy and hallucination rate are correct and don't need fixing.
Table 5. Fixed table of Qwen3-0.6B on StableToolBench
We report the tool calling times under different training methods in Table 6. The results show that the model learns to correct hallucinated tool calls instead of avoiding calling tools.
Table 6. The comparison of different training methods regarding the tool-calling times tested on API-Bank with Qwen3-1.7B as the base model.
In multi-turn situations, we evaluated the BFCL multi-turn subset as shown in Table 7. Our method retained the tool-calling willingness and did a relatively better job on Multi Turn Miss Func and Multi Turn Miss Param, which are specifically designed to see whether the model can avoid unreasonable tool calls.
Table 7. The tool calls under multi-turn situations in BFCL with different training methods.
The Irrelevance Detection subset of BFCL evaluates the model's ability to reject unreasonable tool calls. ToolHallu out-performs other training methods, as shown in Table8, indicating our success of reducing tool-calling hallucination.
Table 8. The Irrelevance Detection results evaluated on BFCL.
[1] Cheng Qian et al. “ToolRL: Reward is All Tool Learning Needs.” NeurIPS 2025
[2] Zihan Lin et al. “ResT: Reshaping Token-Level Policy Gradients for Tool-Use Large Language Models.” ICLR 2026