- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces RISE, a method for compressing video visual tokens that requires no additional training and is agnostic to the user's query. The core process consists of two stages: first, it aggregates recurring visual evidence through local matching and quality-weighted fusion across adjacent frames; subsequently, it employs a low-rank log-det objective to select complementary visual representations within a specified token budget. The authors evaluate the method on LLaVA-OneVision and Qwen3-VL using four video understanding benchmarks and various compression ratios, while also examining the impact of increasing the number of input frames under a fixed token budget.
Critical strengths
- The problem addressed is of practical value, and the method’s operational requirements are favorable. Redundancy in video-based visual tokens is a key factor affecting inference efficiency for long videos; RISE requires no additional training and employs a compression process independent of specific queries, making it valuable for deployment and reuse.
- Experiments cover a range of models and compression budgets, yielding compelling results. The paper evaluates the method across two model architectures and four benchmarks. Notably, with Qwen3-VL, RISE achieves average scores 2.7 and 3.3 points higher than the strongest baselines in the respective settings at retention rates of 20% and 10%, demonstrating its practical effectiveness.
- The authors provide extensive supplementary experiments. The appendix includes component ablation studies, and repeat experiments, while the main text examines inputs of 160 and 320 frames under fixed token budgets. These experiments provide a basis for assessing the method's usability and its capability to handle long-sequence inputs.
Critical weaknesses
1.There is a lack of sufficient comparison with highly relevant recent methods, and the specific contributions of the proposed approach have not been clearly established. The primary experiments compare the method only against FastV, VisionZip, FastVID, and AOT, failing to adequately cover recent video token compression techniques directly related to RISE.
- UniComp (CVPR 2026) preserves essential video information through frame fusion, token budget allocation, and compression based on information uniqueness—approaches highly relevant to the "integrating redundant evidence and preserving complementary information" strategy proposed in this paper—yet the manuscript lacks corresponding discussion and experimental comparisons.
- FlashVID (ICLR 2026) combines attention- and diversity-driven token selection with tree-based spatiotemporal merging;
- HoliTom (NeurIPS 2025) enhances inference efficiency through global redundancy-aware temporal segmentation, spatiotemporal merging, and internal LLM compression;
- STTM (ICCV 2025) investigates multi-granularity spatiotemporal token merging. Although the paper cites these works, it does not include them in the experimental evaluation.
In particular, while the paper characterizes FlashVID as representative of the "select-then-merge" paradigm, it provides no direct comparison; consequently, it fails to sufficiently demonstrate the specific advantages of the RISE approach, which emphasizes "integrating redundant evidence before selecting complementary information."
2.Regarding the efficiency comparison in Table 6 using different token retention rates, the conclusions require precise qualification. Specifically, the 796.8-second runtime for RISE at a 10% retention rate is compared against the 1,103.5-second and 1,181.2-second runtimes for FastVID and VisionZip at a 20% retention rate.
Based on my understanding of the field, the prefill time should be same for the same retention rate, making such a comparison unnecessary; what truly matters is the time spent on preprocessing prior to the prefill stage.
3.There are inconsistencies regarding the numerical values and statistical metrics in the efficiency analysis of Figure 4.
In the main text, when discussing Figure 4(d), the relative accuracy of FastVID on Qwen3-VL is stated as 79.3%; however, the result corresponding to a 20% retention rate in Table 2 is 92.6%, and the value shown in the figure is also approximately 92.6%. This error significantly exaggerates the performance gap described in the text and should be corrected.
Questions for authors
See weakness. If the mentioned related works are adequately compared, demonstrating the superiority of this method, I would consider raising the score.
13 comments
Response to Weakness 2 (Comprehensive efficiency analysis)
W2: Regarding the efficiency comparison in Table 6 using different token retention rates, the conclusions require precise qualification. Specifically, the 796.8-second runtime for RISE at a 10% retention rate is compared against the 1,103.5-second and 1,181.2-second runtimes for FastVID and VisionZip at a 20% retention rate. Based on my understanding of the field, the prefill time should be same for the same retention rate, making such a comparison unnecessary; what truly matters is the time spent on preprocessing prior to the prefill stage.
A2: Thank you for your comment and your insightful question. We will explain it and offer the results under the same retention ratio.
- Response on the fairness of prefilling time comparison. As you have noted, FlashVID also compares methods under different retention ratios in its Table 6. We adopt a similar setting because it is difficult to simultaneously balance accuracy and prefilling time in a perfectly controlled manner. For a fair comparison, we therefore report prefilling time when our method achieves comparable or even higher accuracy.
- Response on LLM forward time. The point about LLM forward time would be most direct if the number of retained tokens were exactly the same across methods. However, in practice, the actual number of retained tokens may differ slightly due to rounding and implementation details. For example, in the open-source implementation of FlashVID cited by the reviewer, some retention ratios lead to a slightly higher number of retained tokens, as also discussed in the project’s issue tracker. Consequently, the reported prefilling time naturally varies across different compression methods.
- Results of our method: The prefilling time comprises both compression time and LLM forward time. We report our results of efficiency below under the same retention ratio. The results in Table 2 demonstrate that Compared with other methods, RISE exhibits obvious end-to-end acceleration and high inference speed. Specifically, compared with FlashVID, RISE reduces GPU memory by 6.5%, TTFT by 15.8%, and model latency by 9.5%, with comparable prefilling time (293.73 ms vs. 288.29 ms). Compared with HoliTom, RISE further reduces TTFT by 45.8% and model latency by 31.3%, while maintaining similar prefilling time. These results demonstrate that RISE achieves superior end-to-end inference efficiency and memory efficiency despite its additional compression overhead.
Table 2: Efficiency of RISE on Qwen3-VL under 10% retention ratio
| Method | GPU Memory (GiB) | Compression Time (ms) | LLM Forward (ms) | Prefilling Time (ms) | TTFT (ms) | Model Latency (ms) |
|---|---|---|---|---|---|---|
| HoliTom | 18.94 | 61.33 | 232.68 | 294.01 | 1829.12 | 2705.71 |
| FlashVID | 19.58 | 53.15 | 235.14 | 288.29 | 1177.81 | 2054.63 |
| RISE | 18.31 | 61.90 | 231.83 | 293.73 | 991.43 | 1859.95 |
Response to Weakness 3 (Typo in our paper)
W3: In the main text, when discussing Figure 4(d), the relative accuracy of FastVID on Qwen3-VL is stated as 79.3%; however, the result corresponding to a 20% retention rate in Table 2 is 92.6%, and the value shown in the figure is also approximately 92.6%. This error significantly exaggerates the performance gap described in the text and should be corrected.
A3: Thank you for your pointing out the problem. This is a typo when we correct it to a right figure. We will rectify it in the manuscript.
Response to Weakness 1 (More baseline comparison and specific analysis)
A1: Thank you for your comment.
Table 1: Comparison with recent video token compression methods on LLaVA-OneVision under different retention ratios.