- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes VERSE, a new framework for training VLMs’ geometric tool use. It focuses on the process reward during vision tool calls, on top of the conventional outcome reward. The process reward is verified by object grounding and geometric path fidelity. On VSI-Bench and MAZE, VERSE improves upon the base Qwen2.5-VL.
Critical strengths
(1) The motivation of adding a process reward to supervise tool-call soundness, on top of just the outcome, is insightful, and the method is designed accordingly to exactly oversee visual tool-use trajectories.
(2) The rich analyses in the paper also support this intuition of process supervision, as the process fidelity correlates with the final outcome, and the grounding accuracy evidently improves throughout training. These are interesting findings.
Critical weaknesses
(1) A fairer baseline in support of the idea of "process reward" would be pure outcome-driven RL, rather than the base VLMs. The authors ablated this in Tab. 2, but it’s limited to VSI-Bench, and the comparison should be made on all benchmarks where this paper claims improvement in Tab. 1. Furthermore, although the intuition behind process supervision for visual tool use is clear, the advantage compared to the conventional outcome-only reward seems marginal in Tab. 2.
(2) Judging from Tab. 1, it seems VERSE works much better on the smaller VLM (3B) than on the 7B one, and its effects may diminish with more capable base models.
Questions for authors
(1) Considering that the path fidelity correlates strongly with the outcome (Fig. 4), would outcome-only RL also induce better path fidelity and object grounding (Tab. 3), even without explicit supervision over them?
(2) Related to weakness (2), how does the method scale with larger VLM variants?