- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes SAW, a sink-aware weighting framework for video reasoning. The paper observes that hallucinated reasoning tokens tend to exhibit lower frame-attention entropy and higher peak attention, and uses frame-attention concentration as a proxy for attention sinks. Based on this signal, SAW assigns continuous token-level weights to both SFT losses and GRPO advantages, downweighting tokens whose attention is relatively concentrated on a small number of frames. The paper additionally constructs SAW-CoT by correcting hallucinated reasoning traces. SAW achieves strong results across several video reasoning and hallucination benchmarks.
Critical strengths
-
Strong empirical results. SAW consistently improves over the Qwen3-VL-8B backbone on all five video QA benchmarks and achieves the best average performance among the evaluated open-weight models with complete results.
-
Clear and well-designed experiments. The paper separately evaluates supervision refinement, sink-aware SFT weighting, standard GRPO, and sink-guided advantage modulation, making the contribution of each component relatively clear.
-
Simple and practical method. SAW uses frame-attention concentration to compute bounded token weights and applies the same idea to both SFT and RL. It does not require any change to the backbone architecture, making the method easy to apply to existing models.
Critical weaknesses
-
The definition of the sink score is not well justified. SAW treats low frame-attention entropy as sink-like behavior, but concentrated attention is not always bad. Some questions can be answered from only a few key frames, so focusing on these frames may be correct. More importantly, the score cannot tell whether the model is focusing on irrelevant frames or the correct key frames. Both cases receive a high sink score and are downweighted. The authors also acknowledge that attention concentration alone cannot distinguish useful focus from spurious sinks.
-
The causal link between more distributed attention and better performance is not established. The paper shows that SAW makes frame attention more distributed and also improves accuracy, but this is only a correlation. It is still unclear whether the accuracy improvement is really caused by the more distributed attention, or by other changes introduced during training.
-
The method generally favors more distributed frame attention without considering what type of evidence each question requires. Some questions need information from many frames, while others may only depend on a few local frames or object details. In the latter case, sparse attention can be correct rather than problematic. The bounded weighting may reduce the negative effect, but it does not solve this basic ambiguity.
Questions for authors
see weakness