- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces VERMOST, a benchmark for multi-object, multi-state transition understanding that requires models to identify not only what changes in a video but also the specific causes supported by visual evidence. It further proposes a graph-guided reasoning framework that tracks object-state evolution, reasons over temporally distributed evidence, and verifies causal explanations, leading to substantial improvements over direct VLM prediction.
Critical strengths
- The figures are clear and easy to understand.
- The expeirments partially show the effectiveness of the proposed method.
Critical weaknesses
- The motivation is currently demonstrated mainly through failure cases of Qwen3.5-9B in Figure 1, making it unclear whether the identified object–state association and causal attribution errors remain substantial for stronger contemporary multimodal models.The paper should evaluate whether such failure modes persist with stronger backbones and whether the proposed graph-guided reasoning framework still provides consistent gains when applied to them. Otherwise, it is difficult to determine whether the proposed task addresses a general limitation of current video understanding systems or primarily compensates for weaknesses of the chosen backbone.
- The dataset construction pipeline raises a concern because the same Qwen3.5-9B model that is shown to suffer from object–state association and causal attribution errors is also used to generate the initial annotations. The paper should report the correction rate and human annotation cost, and ideally compare against independently annotated human labels to assess annotation bias.
- The Cause Score does not directly evaluate visual grounding, since the evaluator only compares the predicted and reference explanations without access to the video frames. This makes it unclear whether a high score truly reflects visual evidence-based reasoning rather than textual agreement with the reference explanation.
Questions for authors
See the weaknesses above.