- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents OmniDelta, a training-free framework for allocating token budgets in Omni-modal Large Language Models. It uses modality-specific skill pools to allocate the retained-token budget between audio and video according to the query. Within each modality, it further distributes the budget across audio segments or video frames based on local complexity and temporal redundancy. The framework preserves the total token budget and can be integrated with existing token selection methods. Experiments on four audio-video benchmarks with Qwen2.5-Omni-3B and 7B demonstrate favorable accuracy–efficiency trade-offs.
Critical strengths
-
The paper is well written and clearly presented. The overall framework and the two levels of budget allocation are easy to follow, with useful illustrations and explanations.
-
The motivation is clear and intuitive. Different queries require different audio and visual evidence, while the information content varies across segments and frames, making adaptive budget allocation a reasonable design.
-
The experimental evaluation is thorough and supports the proposed approach. Results across four benchmarks, together with ablations, compatibility with different token selection methods, and memory and latency measurements, make this a solid piece of work.
Critical weaknesses
Overall, the paper presents a solid and well-developed study, and I have no major concerns. My only suggestion is to make the comparison more comprehensive by including additional video token compression baselines, such as VidCom2 [1] and HoliTom [2]. Although DyCoke is already included, evaluating these methods on the visual branch with the same audio processing strategy and matched total token budgets would further clarify OmniDelta’s advantages. I also encourage the authors to include experiments on Qwen3-Omni-30B-A3B to demonstrate applicability to a newer and larger Omni model and strengthen the empirical contribution.
[1] Xuyang Liu, Yiyu Wang, Junpeng Ma, and Linfeng Zhang. Video compression commander: Plug-and-play inference acceleration for video large language models. In EMNLP, 2025.
[2] Kele Shao, Keda Tao, Can Qin, Haoxuan You, Yang Sui, and Huan Wang. Holitom: Holistic token merging for fast video large language models. In NeurIPS, 2025.
Questions for authors
See Weakness.
3 comments
I appreciate the authors' detailed clarifications and extra experiments. These additions substantially strengthen the completeness of the work and thoroughly resolve all my concerns. Consequently, I have increased my score from 3 to 4.
Follow up Response to Reviewer fGd1
Dear Reviewer fGd1,
Thank you for your updated evaluation and for raising the score. We appreciate your recognition of our work. Your constructive feedback has helped us clarify OmniDelta’s budget-allocation design and strengthen the evaluation of its effectiveness and compatibility with existing pruning strategies.
We encourage the community to use and build on OmniDelta. Its lightweight budget allocator can be integrated with different token-pruning strategies, with our experiments demonstrating accuracy gains while preserving their token-selection rules. We welcome broader adoption and extensions to additional compression pipelines.
We sincerely appreciate your time, careful review, and constructive discussion, which have helped improve our manuscript.
Best regards,
The authors
Thanks & Initial Response to Reviewer fGd1
[Suggestion - Broaden comparisons with VidCom² and HoliTom using the same audio-processing strategy and matched total token budgets, and evaluate Qwen3-Omni-30B-A3B.]
Thank you for your positive assessment and helpful suggestions. OmniDelta combines lightweight modality routing with accuracy gains across compression backends. Below we summarize its advantages in (1) skill-driven inter-modal allocation, (2) content-aware intra-modal allocation, and (3) compatibility with existing selectors, followed by the requested 7B/30B comparisons.
(1) Skill-driven inter-modal allocation provides accurate, lightweight modality guidance. Matching queries to task keywords and phrases estimates which modality supplies the answer evidence. In the full-query, Top-3 diagnostic in
Figure 3, routing accuracy is 78.5%, versus 52.7% for the best tested direct query–audio/video representation (+25.8 percentage points, pp). Cached skill vectors require only query input-embedding lookup/pooling and vocabulary matching, without an additional audio/video encoder or LLM forward pass.(2) Content-aware intra-modal allocation preserves evidence through local budgets. Segment/frame quotas reflect local complexity and temporal redundancy. Adding this allocation to A/V-only improves WorldSense, AVUT, Video-MME, and DailyOmni by 0.2, 0.8, 0.6, and 1.1 pp, respectively (
Table 4), supporting coordination between the two allocation levels.(3) Allocation alone improves existing selectors. OmniDelta preserves each backend's selection rules. OmniFocus gains 2.2 pp on AVUT at 7B; mean gains on Qwen3-Omni-30B-A3B-Instruct are Zip +0.80, Focus +0.65, Select +0.61, and Scope +0.94 pp. Original
Table 5also reports gains in all eight OmniSIFT benchmark–retention combinations.Among the closely related OmniLLM token-compression studies we reviewed, this 30B model is one of the largest and most capable evaluated backbones, extending validation beyond 7B to a new backbone. VidCom² and HoliTom use their own visual compression with the same OmniZip audio-pruning strategy. All compressed methods retain 25% of total audio/video tokens, with matched evaluation settings per backbone. Accuracy is in %; parentheses show backend-relative changes in pp, calculated before rounding. Bold marks the highest compressed accuracy; Full Tokens is the uncompressed reference.
Qwen2.5-Omni-7B:
OmniDelta (Zip) leads all four benchmarks, exceeding VidCom² by 0.6–2.4 pp and HoliTom by 0.8–1.8 pp. Only WorldSense was completed for 7B OmniSelect because of AudioCLIP processing time; its 30B evaluation covers all four benchmarks.
Qwen3-Omni-30B-A3B-Instruct:
OmniDelta (Zip) leads three benchmarks and ties OmniZip on Video-MME. It exceeds both visual baselines on all four, including +2.67/+3.76 pp over VidCom²/HoliTom on DailyOmni. Across backend adaptations, 14 of 16 comparisons improve, one ties, and one decreases (Select on DailyOmni, −0.16 pp).
We will document the comparisons, common audio protocol, and backend interfaces in Appendix H.1: Comparisons with Concurrent Methods and Backend Adaptation, and connect the routing and allocation evidence in Appendix H.2: Allocation Ablations and Task-Evidence Analysis.