- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper trains crop-and-inspect policies using synthetic GUI grounding tasks. Teacher-trajectory SFT initializes tool use, followed by RL with outcome-gated spatial rewards, a small-target bonus, a textual critic, and selective response updates. The resulting policies improve GUI grounding and transfer to non-GUI perception, high-resolution imagery, and charts.
Critical strengths
- Transfer beyond protocol learning. Relative to inspection-capable SFT baselines, RL improves PerceptionBench by approximately 3.0 and 4.5 points across two backbones, with additional gains on HR-Bench and ChartQAPro (Table 2; Figure 2). This supports GUI grounding as a useful supervision source beyond interfaces.
- A consequential negative control. Outcome-only RL improves grounding while reducing PerceptionBench performance; the full configuration improves both (Table 3). This usefully demonstrates that source-domain success alone does not guarantee transferable observation behavior.
Critical weaknesses
- The distinctive update mechanism is not isolated. Table 3 ablates rewards but does not separately remove spatial masking and surprisal-based filtering. A correctness-plus-critic control without spatial supervision is also missing, limiting attribution to the proposed spatial credit-assignment design.
- Improved observation allocation is only indirectly supported. Equal maximum inference budgets do not imply equal actual tool or token use. Appendix F explicitly encourages a successful crop, while the reconstructed histories in Table 4 cannot establish learned stopping behavior. Actual cost and tool-utility measurements are needed for the broader behavioral claims.
Questions for authors
- Experimental clarification: What happens when spatial masking and surprisal filtering are removed separately, and when RL uses correctness plus the critic without spatial rewards or masking?
- Behavioral clarification: How do SFT and RL compare in actual calls, visual/text tokens, and accuracy at matched realized cost? Do the transfer gains remain stable across repeated training runs?
Thank you for your thoughtful review and constructive feedback. We would be grateful to hear whether our rebuttal has addressed your concerns regarding the technical contributions, experimental comparisons, and reliability of the improvements.
As the discussion period approaches its conclusion, we would greatly appreciate any follow-up feedback. If any concerns remain, please let us know so that we can address them. Thank you again for your time and careful consideration of our work.