- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This article focuses on the problem of video event prediction. It introduces an agentic framework VepAgent that is trained with tool-augmented RL over a self-built CoT dataset futurebench-4k. For RL training, the authors introduce two dedicated rewards, i.e., a causal gap reward and an anti-prior reward. VepAgent is compared against a series of MLLMs on FutureBench and NEPBench, and shows promising performance.
Critical strengths
- The motivation to explore an agentic framework for the complex video event prediction task makes sense to me, and offer a promising direction for the domain.
- The approach demonstrates substantial performance improvements over existing MLLMs on standard datasets. Particularly noteworthy is that VepAgent, with a relatively small 4B-parameter base model, outperforms some larger models, e.g., Qwen2.5-VL-72B.
Critical weaknesses
- While the motivation is clear, the proposed framework primarily integrates existing techniques (e.g., SFT+GRPO), with limited methodological novelty. Although this integration is practically useful, the paper does not sufficiently distinguish its technical contributions from those of existing tool-augmented video MLLMs.
- The experimental evaluation has several important limitations. First, the approach is compared only against standalone, general-purpose MLLMs. However, it is clear that the tool access and computational budgets between the proposed approach and the competitors are different. And task-specific VEP methods are not compared. This makes the comparison unfair and the results unconvinced. Second, experiments are conducted exclusively with a 4B-parameter backbone, and the generalizability and scalability of the method across different backbones/model sizes are unexplored. Third, the evaluation does not include proprietary MLLMs (e.g., GPT or Gemini).
Questions for authors
- It is unclear how the agent learns to invoke the diagnostic tools. Does the futurebench-4K dataset include tool-call annotations in CoTs?
- The paper only provides a conceptual description to the causal gap reward, a more rigorous formulation is better to help understanding.
- What is the motivation for treating the format reward as a hard gate rather than an additive reward component? The design choice should be justified.
- How are the coefficients of the rewards determined? Here lacks a sensitivity analysis to them.