- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
- This paper investigates temporal grounding in MLLMs, showing that query-relevant temporal cues captured by specialized attention heads during prefilling often become misaligned during decoding.
- To address this, the authors propose a training-free inference framework that extracts and debiases prefill attention signals to identify candidate intervals, selectively regenerating predictions from the cropped video segments.
- Evaluations across three TimeLens-Bench datasets using MiMo-VL, Qwen3-VL, and Molmo2 demonstrate consistent gains without parameter updates.
Critical strengths
-
Well-motivated problem formulation and clear presentation. The paper compellingly frames the discrepancy between prefill attention and decoded timestamps, seamlessly bridging this empirical observation with the proposed inference framework through concise, well-structured exposition.
-
Broad transferability across model families and scales. Without parameter updates, the framework consistently improves MiMo-VL, Qwen3-VL, and Molmo2 across three benchmarks and scales effectively across Qwen3-VL 4B, 8B, and 32B variants.
-
Clear formulation and strong reproducibility. The paper thoroughly specifies the attention extraction, debiasing, and confidence-gating procedures (alongside prompts and head indices in the appendices), while showing that just 200 held-out calibration samples suffice to recover the optimal heads and downstream performance.
Critical weaknesses
-
Incremental technical novelty over prior attention-based grounding and intervention methods. Prior work has already established training-free grounding via sparse localization heads (A), attention debiasing and guided cropping to recover accurate internal perception (B), and causal interventions on key cross-modal heads in video MLLMs (C).
-
Unestablished causal link between decoding attention drift and localization errors. Comparing query-token and numeric-answer-token attention conflates inference stage with token semantics; because visual cues are often aggregated into question tokens before routing to answer tokens (D), weaker direct answer-to-video attention does not necessarily imply lost visual evidence.
-
Unfavorable accuracy-latency trade-off on stronger grounding models. Mandatory zero-video debiasing passes and two-stage regeneration increase average inference latency by 2.1–2.4× (Table 14), yet yield only marginal gains (0.2–0.4 mIoU, Table 13) on the VTG-specialized TimeLens-8B model.
-
Evaluate transfer to reasoning-intensive temporal grounding. Using the TG-Heads and thresholds calibrated on standard grounding benchmarks, evaluate the framework on queries that require multi-step temporal reasoning to test whether prefill attention remains effective beyond direct event perception.
-
Incompatibility with FlashAttention and unprofiled extraction overhead. Materializing full attention weights appears fundamentally incompatible with efficient FlashAttention inference, yet the paper lacks a thorough analysis of this limitation. Because the authors neither isolate the latency and peak-memory overhead of attention extraction nor clarify whether the baseline in Table 14 uses fused attention kernels, the true deployment cost remains unclear.
[A] Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding, CVPR2025
[B] MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs, ICLR2025
[C] Understanding Temporal Logic Consistency in Video-Language Models through Cross-Modal Attention Discriminability, CVPR2026
[D] Cross-modal Information Flow in Multimodal Large Language Models, CVPR2025
Questions for authors
None