- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces a fundamental question for XR systems: they need to transmit critical visual evidence for reasoning under physical bandwidth constraints and ambiguous query expression. Existing methods attempt to use gaze cues to assist with ambiguous query expression. However, they lack both task-matching benchmarks and methods to utilize gaze cues for visual wrapping effectively. To this end, this work proposes the GazeRefer-GQA benchmark, which consists of local and global reasoning tasks with both gaze cues and ambiguous query expressions. Beyond the benchmark, it proposes GazeWarp, a lightweight module to predict the visual evidence and a density-equalized wrapping method, leading to reduced transmission bandwidth.
Critical strengths
- This work seek to solve a fundamental and interesting question that how to locate and transmit visual evidence under ambiguous query expression and bandwidth constraints.
- The proposed GazeRefer-GQA benchmark have established a well-organized construction pipeline and evaluation for the community.
- The proposed GazeWarp is plug-and-play method, and authors have conduct solid and comprehensive experiments across different backbones demonstrating its superior performance.
- The paper have good writing and easy to follow.
Critical weaknesses
- The cross-dataset evaluation remains limited compared to the extensive experiments on GazeRefer-GQA.
- Lacks ablation on the isolating the contribution of region predictor and density-equalized wrapping method, respectively.
Questions for authors
- My major concern with this work is that Gazewarp seems to be closely tied to the proposed benchmark, GazeRefer-GQA. Could Gazewarp be evaluated more extensively on other public benchmarks with gaze cues?
- Do authors evaluate it on the real-world scenarios beyond synthetic benchmarks?