- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ONCE, a video token compression framework based on a reusable global codebook. Instead of performing token clustering independently for each video, ONCE learns a codebook offline using temporal stratified sketching and frequency-aware optimization. During inference, visual tokens are assigned to selected codewords and aggregated through mean pooling to reduce the number of tokens processed by the LLM.
Critical strengths
-
Offline-to-Online Compression Paradigm. Unlike existing methods that perform token grouping separately for each video, ONCE learns a reusable global codebook offline. This design reduces the need for repeated per-video clustering and offers potential practical benefits.
-
Effective Temporal Stratified Sketching. The proposed temporal stratification helps preserve feature coverage across different video segments during codebook learning. The ablation results demonstrate its importance, as removing temporal partitioning leads to a significant accuracy drop.
Critical weaknesses
-
Limited Novelty. The proposed method mainly combines existing techniques, including clustering, nearest-neighbor assignment, and mean pooling. The algorithmic novelty beyond these standard operations is relatively limited.
-
Weak Accuracy-Efficiency Trade-off. At a token budget of 512, ONCE achieves only around 3.1% lower latency than FastVID, while showing worse accuracy (54.50% vs. 56.45% on MVBench). This limits the practical benefits of the proposed method.
-
Insufficient Analysis of Online Compression Overhead. Although ONCE moves codebook learning offline, inference still requires similarity computation with 8,192 codewords and token reassignment. A detailed breakdown of the online compression latency is missing, making it difficult to assess the actual efficiency gains.
Questions for authors
No