- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies rubric-guided reinforcement learning in video reasoning. To address the issue of answer-level rewards providing limited guidance on the reasoning process, this paper proposes a rubric-guided reinforcement learning framework named VideoRubric that studies process supervision for VideoQA. Specifically, VideoRubric leverages specific rubrics and abstract rubrics to learn sample-conditioned evidence and reusable patterns, respectively. The experimental results on Qwen2.5-VL-7B-Instruct with 1K rubric-augmented samples validated that the proposed VideoRubric achieves competitive results on multiple benchmarks.
Critical strengths
-
The exploration of rubric granularity in reinforcement learning for video reasoning is technically sound and interesting.
-
The experiment showing that Qwen2.5-VL-7B-Instruct optimized on 1K rubric-augmented samples achieves strong performance across multiple benchmarks is interesting.
-
This paper is well-organized and easy to read. The authors provided extensive experimental details in the appendix.
Critical weaknesses
-
From the results in Table 1, we can see that 1K RL data has achieved strong results. Have the authors tried experiments with more RL data?
-
The training costs, such as GPU hours, are not provided in this paper. Could the authors provide the results?
-
In this paper, the teacher model and abstraction model play a key role in RL data generation. Did the authors investigate the effect of different models on this process?
Questions for authors
After reviewing this paper, I have two critical questions that require a response from the authors.
-
Have the authors tried experiments with more RL data? Would more rubric-guided RL data produce better performance?
-
Did the authors explore different settings for the teacher model and abstraction model? Would a more capable model produce high-quality rubric RL data and lead to further performance gains?