- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper focuses gaze-guided keyframe selection in egocentric video question answering. The proposed method leverages human gaze signals to identify potentially relevant moments, performs query-conditioned visual grounding, and selects a compact set of evidence frames based on temporal relations. The paper also introduces GazeKeyBench, a new benchmark that directly evaluates keyframe selection through human-annotated evidence windows and sufficient evidence sets. Experiments demonstrate some improvements over uniform sampling and several naive gaze-based selection methods.
Critical strengths
- I find the idea of incorporating human gaze signals into egocentric video understanding relatively novel and interesting. Using gaze to guide evidence selection offers a promising direction for improving the efficiency and effectiveness of video understanding.
- The paper introduces GazeKeyBench, a new benchmark for directly evaluating keyframe selection. This is a valuable contribution because it enables the evaluation of evidence selection with gaze signals.
- The experimental results provide some evidence that GazeSieve improves upon simple uniform sampling and naive gaze-based selection strategies. These improvements offer empirical support for the effectiveness of the proposed approach.
Critical weaknesses
- The paper appears to be unfinished. In particular, Appendices D and E are empty. This affects the completeness and soundness of the submission.
- The overall presentation could be improved. The GazeSieve pipeline is relatively complicated, but the explanations are not always sufficiently clear. In particular, Figure 2 is poorly organized, and the text within its subfigures is too small to read comfortably, making it difficult to understand the overall workflow and assess the proposed method.
- The experiments primarily rely on Qwen2.5-VL-7B-Instruct, which is a relatively outdated vision-language model. Evaluating the proposed method with more recent and capable MLLMs would provide stronger evidence of its effectiveness and generalizability.
- The evaluated baseline, such as uniform sampling, is too simple. Maybe some learnable frame selection methods should be compared.
- The AI Use Statement (L479) still contains unfilled template placeholders rather than an actual disclosure. This further suggests that the manuscript is incomplete and raises concerns about whether the authors have adequately addressed the conference's AI disclosure requirements.
Questions for authors
- Could the authors explain why the submission is incomplete? (see weaknesses 1 & 5)