- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes AllocEmbed, a framework for improving video retrieval under a fixed visual input budget. Instead of using a small number of uniformly sampled frames at the same resolution, AllocEmbed distributes the available budget across a denser frame sequence by adaptively adjusting per-frame resolutions. The authors further introduce Retrieval-Driven Policy Optimization (RDPO), which trains the allocation policy using retrieval ranking feedback and an efficiency incentive while keeping the embedding backbone frozen. Experiments on MMEB-V2 and the newly constructed LongRet benchmark show improvements over several budget-matched baselines, along with cross-model transferability.
Critical strengths
-
The paper addresses a meaningful trade-off between temporal coverage and spatial resolution under constrained visual input budgets. The allocate-then-embed framework is intuitive and can be applied without modifying the embedding backbone.
-
The experiments cover multiple retrieval tasks and four embedding backbones. The consistent average improvements, particularly on LongRet, and the transferability across different backbones support the practical potential of the proposed approach.
Critical weaknesses
-
The proposed method appears to offer limited methodological novelty. The proposed method closely follows ResAdapt in both its allocator architecture and reinforcement learning framework. RDPO mainly introduces retrieval-specific reward designs within an existing GRPO/PPO-style optimization framework. While these adaptations are reasonable, the overall methodological novelty appears limited.
-
The latency analysis compares AllocEmbed against a more expensive full-resolution baseline instead of budget-matched alternatives, and excludes preprocessing overhead. As a result, the practical efficiency benefits of the proposed framework remain insufficiently demonstrated.
[1] Huanxuan Liao, Zhongtao Jiang, Yupu Hao, Yuqiao Tan, Shizhu He, Ben Wang, Jun Zhao, Kun Xu, and Kang Liu. Resadapt: Adaptive resolution for efficient multimodal reasoning. arXiv preprint arXiv:2603.28610, 2026.
Questions for authors
-
What is the main technical contribution beyond ResAdapt? Since the allocator architecture and scale policy are largely inherited from ResAdapt, could the authors clarify what is fundamentally new in RDPO beyond adapting existing policy optimization methods to retrieval-specific rewards?
-
Does AllocEmbed provide a meaningful benefit over uniform allocation when accounting for its additional overhead? The improvements on MMEB-V2 are relatively small. Could the authors provide an end-to-end latency comparison against budget-matched baselines, including allocator inference and preprocessing costs?
-
The experiments only cover embedding backbones up to 8B parameters. Does AllocEmbed remain effective on larger-scale embedding models (e.g., 13B or above), particularly when transferring the allocator without retraining?