- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces VideoLedger, a training-free framework for long-horizon streaming video understanding. VideoLedger incrementally stores timestamped visual narrations and speech transcripts as chronological text, creating a question-agnostic index linked to the original video. At inference time, an off-the-shelf LMM searches and reads this textual memory to locate relevant evidence and selectively revisits the corresponding raw video clips when finer visual details are needed. This index-and-revisit design avoids repeatedly processing the entire video history while preserving access to the original visual evidence. Experiments across ten long-video QA benchmarks and multiple LMM backbones show strong performance across hour- to month-scale videos, while ablation and efficiency analyses demonstrate the complementary benefits of textual indexing and selective video revisiting.
Critical strengths
Strong and consistent empirical results - VideoLedger achieves large gains across ten benchmarks covering hour- to month-long videos, with consistent improvements across Qwen, GPT, and Gemini backbones. Also, the authors showed efficiency evaluation on latency, token usage, indexing cost and inference cost.
Well-validated index-and-revisit design - The ablations clearly show that speech information and selective source-video revisiting provide complementary improvements over the textual visual timeline alone. Such in-depth analysis supports the effectiveness of the proposed method.
Critical weaknesses
Limited robustness of lexical search - VideoLedger relies on keyword-based lookup, which can miss relevant evidence when the question and memory use different words. I acknowledge that the authors stated this point in the limitation. However, I think this is too big limitation which would weaken the robustness of the proposed method. Therefore, I think related experiment need to be provided rather than stating this point in the limitation.
Different visual budgets used for direct-inference comparisons - The direct baselines uniformly sample up to 1,024 frames, while VideoLedger selectively revisits at most 10 clips. A matched-budget comparison would better isolate the benefit of targeted retrieval from differences in visual access.
Limited methodological novelty - The main contribution is primarily a system design that combines existing components, including textual video descriptions, lexical search, and selective source-video access. While the resulting system is simple and effective, the methodological novelty beyond prior memory-based and agentic video retrieval systems appears limited.
Questions for authors
Please refer to the weaknesses