- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Multiscale Spatial Voting (MSV) for test-time GUI grounding. MSV resizes the full screenshot to multiple scales, performs grounding at each scale, maps predictions back to the original coordinates, and aggregates them using spatial voting. The method is evaluated on multiple GUI benchmarks and backbones, showing improvements in many settings.
Critical strengths
The paper is clearly written, and the method is straightforward and easy to follow.
Critical weaknesses
The methodological novelty is limited. While I am generally cautious about evaluating a paper primarily based on novelty, multi-scale image resizing, training, and inference have been extensively studied in object detection for many years (YOLOv2 [1], SNIP [2], Autofocus [3], etc.). Here, the paper mainly uses this classical technique as an augmentation strategy for existing GUI grounding methods, without introducing a new training method or learning framework.
The experiments do not validate the claimed mechanism. The motivation of MSV is to better handle GUI elements of different sizes, especially tiny icons (Line 71~75). However, the paper only reports aggregate grounding accuracy and does not analyze performance according to target size or relative bounding-box area. Therefore, it is unclear whether the gains actually come from better handling of targets at different scales, rather than simply from increased inference computation.
reference:
[1] Redmon J, Farhadi A. YOLO9000: better, faster, stronger[C]//2017 IEEE conference on computer vision and pattern recognition (CVPR). Ieee, 2017: 6517-6525.
[2] Singh B, Davis L S. An analysis of scale invariance in object detection-SNIP[C]//2018 IEEE/CVF Conference on computer vision and pattern recognition. IEEE, 2018: 3578-3587.
[3] Najibi M, Singh B, Davis L S. Autofocus: Efficient multi-scale inference[C]//Proceedings of the IEEE/CVF international conference on computer vision. 2019: 9745-9755.
Questions for authors
-
Can the authors report performance separately for tiny/small/medium/large GUI elements to directly validate the main motivation of MSV?
-
Given that multi-scale resizing and inference are classical techniques in computer vision, what is the key technical contribution of MSV beyond applying this established strategy to existing GUI grounding methods?