- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes SEATS, a training-free token selection method to accelerate Omni model inference. It works in three stages: first, it filters out redundant audio-visual tokens before they enter the LLM; then, in the middle layers of the LLM, it continues pruning tokens at a decreasing retention rate, weighted by their relevance to the question; finally, the deeper layers drop the remaining audio-visual tokens entirely.
Critical strengths
-
The experimental observations and the design of the method are coherent, and the writing is clear. The paper separately tests the effects of removing visual and audio tokens, then sets layer-wise retention rates based on those observations, and allocates token budgets by time window and modality, so the logic is throughout.
-
This paper validates the effectiveness of SEATS across multiple models. SEATS retains 94.9% of the average score performance through token selection, achieving a 9.3× reduction in FLOPs, a 4.9× speedup in prefill, and a 1.9× improvement in TTFT.
Critical weaknesses
The novelty of the core layer-wise depth observations is limited. FastV (Chen et al., 2024) already identified the inefficiency of processing visual tokens in deep layers. PyramidDrop (Xing et al., 2024) already reported that visual tokens matter in shallow layers but become increasingly redundant in deeper layers. And the paper's experimental baselines do not include a direct comparison with the closely related work OmniFit (Wang et al., 2026), leaving the gains relative to the nearest method unclear.
Questions for authors
-
Could you compare SEATS against more closely related layer-wise methods such as OmniFit (Wang et al., 2026) under the same model, token budget, and timing conventions? If not feasible, what are the specific obstacles?
-
Under what kinds of inputs would the fixed layer boundaries break down? If the starting and ending layers for pruning were determined dynamically per input sample, could performance be improved?
-
At 10% TRR, prefill achieves a 4.9× speedup and TTFT a 1.9× speedup. Could you further break down the time cost into encoding, pre-LLM filtering, and in-LLM filtering, and show how these vary with different video lengths?
[1] FastV(Chen et al., 2024):An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models
[2] PyramidDrop(Xing et al., 2024):PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction
[3] OmniFit(Wang et al., 2026):OmniFit: Bridging Modalities via Layer-Adaptive Token Compression for Omnimodal Large Language Models
Thank the authors for the detailed response. I have raised my score from 2 to 3, as the rebuttal has strengthened the empirical validation of SEATS. However, I still regard the layer-wise depth observation itself as incremental relative to prior token selection methods; the contribution is a carefully designed and thoroughly validated combination rather than a new insight about token redundancy.