- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
LongVidGraph is a progressive graph memory framework for omni-modal long-video understanding. The method divides videos into minute-long clips and fine-tunes Qwen2.5-Omni to incrementally extract and merge entities, actions, and dialogues. For question answering, it retrieves relevant graph records and uses their timestamps to extract keyframes, combining textual and visual evidence. The authors construct approximately 15K clip–graph training examples and report improvements over the Qwen2.5-Omni baseline on several benchmarks under different settings.
Critical strengths
-
The method improves overall performance over the Qwen2.5-Omni baseline with more pronounced gains on some longer-video subsets, which provides empirical support for the framework’s effectiveness on existing long-video QA benchmarks.
-
The ablations show that retrieved text and keyframes provide complementary information, and the constructed memory improves multiple QA models on LVBench. Therefore, the retrieved evidence has value across models, with benefits extending beyond the fine-tuned model itself.
Critical weaknesses
Evaluation by video duration does not establish long-range dependency modeling, and the paper lacks targeted evaluations of multi-hop temporal reasoning, state tracking, or tasks requiring high-FPS input to demonstrate that the graph preserves critical temporal details. The contribution of audio beyond transcripts and the necessity of an omni-modal model are also not established through audio ablations or questions that require audio.
Questions for authors
-
How much does graph memory improve over clip-embedding retrieval under comparable video coverage, frame counts, audio inputs, and QA models?
-
What are the time and computational costs of graph construction, incremental updates, and per-question retrieval for different video durations? Including graph construction, how does the end-to-end cost compare with clip-embedding retrieval?
-
What audio information does the graph preserve beyond transcripts, speaker information, and dialogue summaries? Are there audio ablations that establish the need for an omni-modal model over a vision-based model supplied with transcripts?