- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces LongVU-TTT, which inserts a convolutional test-time-training layer between the vision encoder and the language model. Grouped convolutional fast weights adapt within each video using a self-supervised alignment objective, contextualizing frame features before compression. Experiments cover five video benchmarks, controlled temporal-operator comparisons, mechanism and selection ablations.
Critical strengths
-
Useful controlled architecture comparisons. The study compares several temporal operators under a shared training subset and input budget.
-
An informative discussion of memory limitations. The evidence-withholding diagnostic supports interpreting fast weights as temporal aggregation rather than dependable episodic storage, motivating explicit evidence retention. Evaluation spans five established video benchmarks.
Critical weaknesses
-
The video-model baselines are dated. Comparisons mainly cover 2024–2025 methods and omit relevant 2026 approaches.
-
The benefit of longer pre-aggregation is unclear. The 512→128 setting gains only 0.30 MLVU points over direct 128→128 processing and loses 0.62 LongVideoBench points. The frame-independent 512→128 baseline also degrades substantially. A matched 128-frame baseline and end-to-end cost comparisons are needed to justify processing four times as many frames.
-
The parallel update rule is underspecified. Equation (3) does not identify the weights at which gradients are evaluated. Chunk-start gradients and sequential online gradients generally define different updates. Explicit pseudocode for gradient evaluation, momentum, stabilization, and chunk boundaries is needed to assess the claimed update behavior.
Questions for authors
-
How does the method compare with relevant 2026 long-video compression approaches?
-
What is the result of a frame-independent 128→128 baseline under matched training and token budgets? Why does the 512→128 baseline degrade, and what accuracy–latency trade-off justifies 512-frame pre-aggregation over direct 128-frame TTT?