- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces a region-wise token compression technique that allocates token budgets according to the complexity of each region. The authors report better preservation of output quality compared with prior image and video token compression methods.
Critical strengths
- The experimental evaluation is extensive, with comparisons against a broad range of baselines.
- The paper is generally well written and easy to follow.
Critical weaknesses
-
My primary concern is the motivation for region-wise compression and its claimed advantage over existing video-wise, segment-wise, or frame-wise approaches. The author tried to state that “these methods generally operate at coarse compression levels, overlooking the varying representation demands of local spatiotemporal regions.” in Line 83. However, to my knowledge, such methods often also perform token-level compression within individual frames. This can implicitly achieve region-wise compression, with the regions receiving different levels of compression varying across frames. Therefore, to me, the proposed approach does not introduce a fundamentally different compression framework or addresses a limitation that prior methods actually exhibit. I would appreciate a more precise discussion of this distinction and remain open to clarification from the authors.
-
Another major concern is whether a video can consistently be partitioned into distinct regions with different levels of complexity. For spatially continuous content, such as rivers or skies, or scenes whose structure changes continuously over time, can the proposed partitioning remain meaningful and temporally consistent? In these cases, the approach appears likely to reduce to token-wise compression. The authors should clarify how regions are defined and maintained under these conditions, and whether region-wise compression retains a meaningful distinction from token-wise compression.
-
Figure 2,3,5 should specify the relevant experimental settings, including the prompts used and the definitions of the reported metrics. Without this information, it is difficult to interpret the results and assess how well they support the paper’s claims.
-
I suggest adding a brief statement of the main takeaway to the captions of Figures 2, 3, and 5. In addition, Figure 4 appears somewhat blurry, and the text in panel (d) overlaps. Improving the image quality and layout would make the figure easier to read.
Questions for authors
-
Can the author show that a video can consistently be partitioned into distinct regions with different levels of complexity? Does this partition fundamentally different than token-wise method?
-
What is the specific experimental settings in Figure 2,3,5?
7 comments
W2 & Q1. Adaptive Partitioning of Continuous Visual Content and Distinction from Token-Wise Compression
We thank you for this valuable comment. We provide additional qualitative analyses in Figs. 12–14 to address these concerns.
1. Partitioning Videos into Regions with Different Complexity Levels. As shown in the third to fifth rows of Figs. 12 and 13, CompVID partitions videos into regions with different complexity levels. Regions containing richer visual details, such as people and buildings in Case 1 and dense jungle and rough trees in Case 2, generally have higher complexity scores and receive more tokens, whereas simple regions, such as the sky and stream, exhibit lower complexity and receive fewer tokens. Figure 14 further compares the retained tokens across different compression methods, showing that CompVID allocates more tokens to regions with higher visual complexity. These visualizations qualitatively demonstrate that CompVID can distinguish regions with different complexity levels.
2. Distinction from Token-Wise Compression. As shown in the second and third rows of Fig. 12, token-wise compression and CompVID produce different token retention patterns. Specifically, we use Max-Min Diversity as the token-wise compression method to select tokens globally under a shared token budget, allowing all tokens to compete directly. Consequently, it retains excessive tokens in simple regions such as the sky while allocating insufficient tokens to visually complex regions. In contrast, CompVID first partitions the video into 3D spatiotemporal regions, determines the token budget of each region based on its complexity, and then performs token selection within each region, allowing tokens to compete locally under the assigned regional budget.
We have added these analyses on Page 29, Lines 1519–1533 (Appendix F.1), and Page 30, Lines 1566–1592 (Appendix F.4), with visualizations on Pages 31–33 (Figs. 12–14).
W3 & Q2. Clarification of Experimental Settings and Metrics in Figs. 2, 3, and 5
We thank you for this comment. We clarify the experimental settings, axis definitions, and metric calculations for each figure below.
1. Figure 2: Regional Complexity and Token Allocation. We uniformly divide the feature volume of a video from VideoMME into eight spatiotemporal regions, using LLaVA-OneVision-7B at a 10% token retention ratio. The horizontal axis represents the eight regions (R1–R8), while the vertical axis represents normalized regional complexity and token budgets. The Complexity Value Curve is calculated using Eq. (4), whereas the Token Budget Curves represent the numbers of tokens retained by FastVID, FlashVID, and CompVID. Specifically, mean-based normalization is applied jointly to the 24 token counts (8 regions × 3 methods) and the eight regional complexity values. The normalization procedure is detailed in Appendix E.4.
2. Figure 3: Token Distribution and Accuracy. The experiments are conducted on LLaVA-OneVision-7B under a 10% token retention ratio. The horizontal axis compares FastVID, FlashVID, and CompVID across VideoMME, LongVideoBench, and MLVU. The bars represent three regional complexity levels: Low, Medium, and High. The left vertical axis (Token Count (%)) indicates the proportion of retained tokens belonging to each complexity level, while the right vertical axis (Accuracy (%)) reports the corresponding benchmark accuracy. As detailed in Appendix B, regional complexity levels are determined using the 1/3 and 2/3 quantiles of complexity scores within each video, and token proportions are calculated by dividing the retained tokens in each category by the total number of retained tokens.
3. Figure 5: Regional Complexity and Logit Margin Gain. The horizontal axis represents normalized regional complexity, while the vertical axis represents normalized logit margin gain. As detailed in Appendix E.2, we analyze 900 VideoMME videos, each divided into eight spatiotemporal regions, yielding 7200 region-level samples. Under a fixed budget of 640 tokens, we increase the budget of one region from 80 to 150 tokens while reducing the budgets of the remaining seven regions from 80 to 70 tokens each. Using LLaVA-OneVision-7B on VideoMME, logit margin gain is calculated as the change in the difference between the correct answer logit and the highest incorrect answer logit, averaged over all questions associated with each video. The Spearman correlation is 0.56, indicating a positive association between regional complexity and the benefit of additional tokens.
These experimental settings and metric definitions are detailed on Page 2, Lines 87–93; Page 3, Lines 120–124; and Page 4, Lines 183–188, with additional calculations provided in Pages 21–22, Lines 1145–1162 (Appendix B); Page 26, Lines 1364–1403 ( Appendix E.2), and Page 28, Lines 1463–1473 (Appendix E.4).
W4. Improvements to Figure Captions and Figure Quality
We thank you for these helpful suggestions. We have revised the captions of Figs. 2, 3, and 5 and improved the visual quality of Fig. 4.
1. Main Takeaways in Figure Captions. We have added brief statements highlighting the main findings of Figs. 2, 3, and 5. Specifically:
- Fig. 2: "The results show that the Token Budget Curves of CompVID align more closely with the Complexity Value Curve, demonstrating better complexity–budget matching across different video regions."
- Fig. 3: "The results show that CompVID retains more tokens in high-complexity regions and fewer in low-complexity regions while consistently achieving higher accuracy across all three benchmarks, demonstrating the effectiveness of complexity-aware token allocation."
- Fig. 5: "A positive correlation (Spearman ρ = 0.56) indicates that higher-complexity regions tend to yield larger logit margin gains."
These statements have been added to the figure captions on Page 2, Lines 64–69 (Figs. 2 and 3), and Page 4, Lines 175–178 (Fig. 5).
2. Figure 4 Quality and Layout. We have replaced the original PNG image of Fig. 4 with a PDF to improve its readability. We have also adjusted the layout of panel (d) to eliminate the overlapping text.
We hope these responses address your concerns comprehensively. Feel free to let us know if you have any additional questions, and we are more than happy to provide further clarification on any aspect of our work.
Respectfully and sincerely,
Your Authors
We appreciate your recognition of the extensive experimental evaluation and that our paper is well written, as well as your valuable feedback. Below, we address your concerns in detail.
W1. Distinction Between Region-Wise and Video-Wise, Segment-Wise, and Frame-Wise Compression
We thank you for this valuable comment. We clarify the distinction between CompVID and existing video-wise, segment-wise, and frame-wise compression methods from two perspectives: methodological differences and qualitative comparisons.
1. Methodological Differences.
We agree that existing methods can perform token-level compression within individual frames, implicitly achieving region-wise compression with different compression ratios across regions and frames. However, their token selection is primarily guided by attention or diversity, rather than regional visual complexity. These criteria are different from complexity-based allocation, as they focus on token importance or redundancy without measuring the complexity of local regions. Specifically, VisionZip (frame-wise) selects tokens based on attention scores and feature similarity, potentially overlooking locally complex regions with low token importance. FastVID (segment-wise) performs temporal segmentation followed by density-based pruning, without explicitly considering complexity differences among spatial regions. FlashVID (video-wise) employs attention- and diversity-based token selection and tree-based merging, focusing on reducing spatiotemporal redundancy without accounting for the varying complexity of local regions. The common limitation of these methods is that regional token retention is an implicit outcome of token selection and merging, rather than explicit allocation based on the complexity of individual 3D spatiotemporal regions. Consequently, locally complex regions may receive insufficient tokens, while simpler regions may retain unnecessary tokens, despite differences in compression ratios across regions and frames.
In contrast, CompVID explicitly partitions the 3D spatiotemporal feature volume along the temporal, height, and width dimensions and allocates token budgets according to the complexity of each region. Thus, the key distinction lies in complexity-guided regional budget allocation. This allows token budgets to directly reflect the varying representation demands of local spatiotemporal regions.
2. Qualitative Comparison. To further examine this distinction, we provide a qualitative comparison with VisionZip (frame-wise), FastVID (segment-wise), and FlashVID (video-wise) in Fig. 14. Although these methods retain different numbers of tokens across spatial regions, the visualizations show that some simple regions retain excessive tokens, while certain visually complex regions receive insufficient coverage. In contrast, CompVID retains more tokens around fine visual details while reducing token retention in simpler regions, consistent with the visual content complexity maps in the bottom row. This comparison further highlights the distinction between complexity-guided regional token allocation and existing video-wise, segment-wise, and frame-wise compression methods.
We have clarified the methodological differences on Page 2, Lines 75–85, and added the qualitative comparison on Page 30, Lines 1566–1592 (Appendix F.4), with the corresponding visualization on Page 33 (Fig. 14).