- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper revisits attention-based visual token pruning and proposes a two-stage method SCOUT. The first stage applied semantic region-aware filtering based on visual encoder's attention and value projection, while the second refines the selection using text-to-visual attention and entropy gating. The authors evaluate the method across several models and datasets.
Critical strengths
None
Critical weaknesses
-
The method seems to offer limited new insight. The pipeline combines several components and introduces many hyperparameters, making it look more like engineering refinement than a clear conceptual advance. The motivation also does not clearly lead to the proposed design: Figure 2(c) supports keeping question-relevant tokens, but does not specifically justify attention–value scoring, which was already used in ATS (Mohsen Fayyaz et al., ECCV 2022). Sink-aware visual pruning has also been explored in SToP (Kibum Kim et al., ECCV 2026), which is not even discussed. More importantly, the link between attention sinks and the proposed entropy gate is not convincingly established.
-
The comparisons are not up to date. All compared methods are from 2025 or earlier. CVPR and ECCV 2026 include a number of relevant works, but none are compared, including Combating Textual Noise and Redundancy: Entropy-Aware Dense Visual Token Pruning (EADP, ECCV 2026). This makes it hard to judge whether SCOUT improves over the current state of the art.
Overall, I do not find either the new insight or the demonstrated performance advantage strong enough for acceptance in an already crowded area.
Questions for authors
-
What is SCOUT’s main new insight compared with existing visual token pruning methods, and how does it lead to the specific design choices? Can any analyses or controlled experiments isolate its contribution from the other components and address the concern about the number of hyperparameters?
-
How does SCOUT compare with recent methods from CVPR or ECCV 2026, such as EADP? If these comparisons are not applicable, could you explain why?
Addressing these concerns would likely require substantial experiments and revisions. Given how crowded visual token pruning has become, I feel the concern about limited new insight may be difficult to resolve in a rebuttal. I would therefore suggest focusing on a revised submission rather than a rebuttal.