- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces SITE, a training-free framework designed to improve temporal reasoning in frozen Vision-Language Models (VLMs) by explicitly organizing question-relevant inter-frame evidence. SITE consists of three stages: Route, which classifies questions into temporal reasoning categories; Surface, which constructs task-specific evidence views through visual organization and prompting; and Corroborate, which aggregates predictions across multiple views using voting and a disagreement verifier.
Critical strengths
- The paper identifies an interesting limitation of conventional frame-based video reasoning and presents the proposed framework in a clear, well-structured manner.
- SITE achieves consistent accuracy improvements across three benchmarks and three frozen VLM backbones.
- The stage-wise ablations, correctness-transition analysis, and evaluations under different frame sampling strategies provide useful evidence of the framework's practical effectiveness.
Critical weaknesses
- The proposed framework primarily combines existing techniques, including question classification, task-specific visual prompting, optical-flow visualization, and prediction aggregation through voting. Although their integration is reasonable, the individual components are relatively conventional, and the paper does not establish a sufficiently distinctive algorithmic contribution beyond their combination.
- The paper attributes performance improvements to recovering dormant temporal reasoning capabilities through explicit evidence formation. However, the current experiments do not clearly distinguish improvements in temporal evidence utilization from those resulting from better prompting, and increased inference computation.
- While the stage-wise ablations are useful, the paper provides limited insight into router reliability, the contribution of individual evidence views, and the extent to which different views provide complementary information.
Questions for authors
- What is the fundamental algorithmic contribution of SITE beyond combining existing visual prompting, question classification, and multi-view prediction aggregation?
- Can the authors provide direct evidence that SITE improves temporal evidence formation rather than simply improving final-answer selection?
- Since the optical-flow view uses information from the full video, how much of the improvement remains when this component is restricted to the same sampled frames as the baseline?
- Could the authors also report the average number of VLM calls, end-to-end latency, and computational overhead across all three backbones?