- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces T-Spatial, an agent designed for spatial reasoning that addresses the issues of potentially ineffective tool usage and coarse-grained credit assignment in multi-turn interactions. The proposed method comprises two components: Difficulty-Aware Trajectory Synthesis (DATS), which constructs either direct-answer or tool-assisted trajectories based on the base model's performance; and Tool Utility Policy Optimization (TUPO), which organizes training signals across four levels—samples, trajectories, branches, and nodes—and optimizes the policy by combining tree-based sampling with changes in answer scores observed before and after tool invocation. The authors demonstrate performance improvements across six spatial reasoning benchmarks and analyze the agent's behavior regarding tool utility and the substitution of the geometric backend.
Critical strengths
- The problem addresses a practical need, and the overall design is coherent. The workflow—spanning from training data construction to reinforcement learning—centers on the necessity and effectiveness of tool use; the use of the answer evaluator for node-level feedback eliminates the need to train a separate reward model, making the implementation approach highly practical.
- Performance gains are significant and substantiated by ablation studies. The 8B model achieved an average score of 62.5 across six benchmarks—a 10.3-point improvement over the corresponding base model—and outperformed standard GRPO by 2.7 points when using the same SFT initialization. Removing either branch-level or node-level signals resulted in a marked performance drop, validating the importance of both components.
- The evaluation includes an analysis of tool-use behavior. Breakdowns of gains and losses associated with tool usage, alongside experiments involving the replacement of the geometry backend without retraining, provide further evidence of the effectiveness and generalizability of the tool-use approach.
Critical weaknesses
- The incremental contribution over existing methods has not been sufficiently validated. While the paper acknowledges related work on answer probes, tree-based credit assignment, and mixed-tool supervision, it lacks comparisons under identical settings with closely related methods such as TACO and Tree-GRPO. Current comparisons focus primarily on standard GRPO, making it difficult to assess the advantages of the joint design over existing mechanisms.
- The rationale behind DATS labeling is ambiguous, and independent ablation studies are lacking. The scenario where a "base model answers incorrectly without tools" while a "stronger teacher answers correctly with tools" simultaneously alters both model capability and tool availability; thus, it does not directly demonstrate that the target model requires tools. Furthermore, the paper fails to compare DATS against alternative construction schemes—such as standard teacher distillation or fixed-ratio trajectory mixing—leaving the specific contribution of DATS itself unclear.
- The reliability of node-level tool utility estimation requires further verification. The change in answer scores observed in Equation (7) is influenced by both intermediate reasoning steps and tool outputs; this approach risks assigning zero reward to necessary tool calls that do not immediately improve the answer. While branching signals might mitigate this issue, there is a lack of controlled experiments to verify the consistency between local rewards and actual tool contributions.
- Evidence regarding computational overhead and efficiency is insufficient. An identical number of rollouts does not equate to equal total computational costs when answer probes are included; the absence of cost comparisons with GRPO—along with missing metrics such as average call frequency and inference latency—means the claim regarding the reduction of redundant tool calls is not adequately supported.
Questions for authors
See Weaknesses.