- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Addressing the issues of redundancy in free-text Chain-of-Thought (CoT) and the lack of grounding for temporal evidence in video-based reasoning, this paper proposes using structured event evidence as a task-agnostic intermediate representation. It introduces GRAB, a method that dynamically balances multiple objectives, such as evidence formatting, task accuracy, and reasoning efficiency, within a unified reward framework. Combined with a progressive training curriculum and a custom-constructed dataset, the approach achieves superior performance over baselines on temporal localization and video question-answering benchmarks, while also enhancing interpretability. Overall, the motivation is clear, the method is lightweight, and the experimental evaluation is systematic; however, there remain concerns regarding the scale of data and models, generalization across patterns, the robustness of the reward design, and the consistency of evaluation metrics.
Critical strengths
The motivation is well-articulated, accurately identifying the drawbacks of unstructured video CoT, such as verbosity and a tendency to drift away from critical temporal evidence.
Structured event evidence organizes entities, actions, scenes, and event boundaries into a unified intermediate representation, offering both interpretability and verifiability.
Critical weaknesses
The scale of both the training data and the primary model is limited, leaving the generalization of the evidence-based approach across larger models, diverse domains, and open-world scenarios under-explored.
The use of a fixed-duration assumption for event segmentation limits the precision of boundary localization; the challenge of adaptive or multi-scale event decomposition remains unaddressed.
The evidence schema is centered on individuals and their actions, which leads to degraded information representation in videos that lack human subjects or are not focused on human activity.
Questions for authors
Please refer to the weaknesses.
3 comments
Dear Reviewer 6p78,
Thank you again for your thoughtful feedback. We hope that our response has helped address your concerns. Please do not hesitate to let us know if there are any remaining questions or issues that we could further clarify.
If you feel that your concerns have been sufficiently addressed, we would sincerely appreciate it if you might kindly consider revisiting your overall assessment.
Dear Reviewer 6p78,
As the discussion period is ending soon, please do not hesitate to let us know if there are any remaining concerns that we could further clarify. Thank you very much for you reviews.
Author Rebuttal
Thank you for your careful review and constructive feedback. Following your suggestions, we have updated paper, and we provide further analyses to address each concern below.
R1. Scale and generalization. Thank you for raising this point. Our main 4B experiments use full-parameter RL training. Although our computational budget does not support the same setting at 8B, we evaluate four RL methods on the 8B model using LoRA and half the RL data. All methods share the same settings. CTL denotes Charades-TimeLens:
We believe our results on public benchmarks, including ETBench, VideoMME, MLVU, and NExT-GQA, have supported generalization across diverse video domains and tasks. Moreover, we further examine performance across the six VideoMME domains below:
R2. Event segmentation. The 10–30 s range is used only to construct training annotations. Shot detection identifies boundaries from the video content, and half of them are reviewed by human annotators. At inference, segment durations are not restricted to the 10–30 s range. A substantial proportion of generated segments fall outside the 10–30 s range on both benchmarks, showing that this range does not constrain segment durations at inference.
We next assess boundary precision using [email protected], which applies the strictest of the three IoU thresholds. On these two benchmarks, this metric shows the largest relative gains over Qwen3-VL-4B-Instruct in Table 1. The comparison with GRPO uses the same segmentation pipeline.
To examine whether this improvement extends to short moments, we divide Charades-TimeLens into three groups by annotated moment duration.
The gains also extend to annotated moments shorter than the 10 s lower bound used to construct training segments.
R3. Videos without people. The scene, object, camera, and event_caption fields in the schema do not depend on people. When no person appears, person and human_action are set to
None, while the remaining fields describe the video as usual.To evaluate this case, we group VideoMME videos using PARSE-4B's evidence. A video is assigned to the no-person group when every person field is
None. Both models are evaluated on the same groups.We will continue to refine the schema to cover a broader range of cases.