- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper primarily focuses on constructing a remote sensing video question-answering dataset. Motivated by the limitations of existing benchmarks, particularly their reliance on template-based questions and lack of temporal information, the authors introduce a new VideoQA dataset based on UAV remote sensing videos.
Critical strengths
- The paper analyzes the limitations of static remote sensing VQA and natural-domain VideoQA benchmarks, providing a reasonable motivation for introducing a remote sensing video dataset.
- The authors have made substantial efforts in dataset construction and annotation, establishing a comprehensive pipeline that includes video filtering, caption generation, question generation, answer generation, and human verification.
Critical weaknesses
- Although the paper introduces a novel data format, it does not sufficiently develop an evaluation protocol tailored to the characteristics of the proposed dataset.
- It remains unclear whether temporal ordering and cross-frame relational reasoning are essential for answering the questions. For instance, even without understanding the temporal order of events, a model might significantly outperform single-frame baselines simply by recognizing more objects, roads, and scene details from the 32 sampled frames. Therefore, it may be necessary to distinguish between visual state changes and temporal relational reasoning to better assess the intended capabilities.
Questions for authors
- Section 3.1 (page 4) states that all videos are trimmed to approximately 15 seconds, while the appendix (page 14) indicates that 32 frames are uniformly sampled from each video. Although this setting is reasonable for conventional short-video question answering, the paper repeatedly emphasizes long-range temporal reasoning and long-range dependencies. How do the authors reconcile this relatively short temporal window with their claims regarding long-range temporal understanding?
Follow-Up on Reviewer Feedback
Dear Reviewer,
As the discussion period is approaching its end, we would like to thank you for your thoughtful feedback. We hope our responses and additional analyses have adequately addressed your concerns.
Please let us know if any questions remain or if further clarification would be helpful. We would be happy to provide additional details.
Thank you again for your time and consideration.