- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The method trains video reasoning with final-answer correctness plus an intermediate-answer signal. It combines Seed1.8 distillation with GRPO on filtered long-video questions; the reward favors correct recovery while penalizing changes between intermediate and final answers. Results beat outcome-only GRPO across several benchmarks and backbones, but the reward's efficiency rationale is not fully validated.
Critical strengths
- Against outcome-only GRPO with the same teacher SFT and filtered RL data, the full method improves all five general-understanding benchmarks. Gains also appear without teacher supervision.
- Accuracy improves across several Qwen backbones, especially Qwen3.5. The recipe uses a relatively small RL set and verifies intermediate answers without a separate process reward model.
Critical weaknesses
- The reward can favor a worse intermediate state. Because , an incorrect intermediate answer earns more than a correct one when final correctness is fixed. Applying the same trajectory advantage to all tokens may therefore reward delaying answerability. Report training-time early/final accuracy and transition rates, and ablate the reward ordering. Appendix C.3 does not remove this incentive: a correct response before the checkpoint can receive less reward than a longer response that first fails and then recovers.
- The accuracy–efficiency advantage over direct answering remains unclear. The method achieves 69.9 on Video-MME versus 69.5 for Instruct, but underperforms on the long-video subset, MLVU, and VSI-Bench. Moreover, Figure 1(b) lacks response-length comparisons with Instruct, SFT-only, and matched GRPO baselines, making it difficult to attribute efficiency gains to the proposed reward. Reporting accuracy, response length, and latency for these baselines would strengthen the claim.
Questions for authors
- How do intermediate-answer accuracy and incorrect-to-correct versus correct-to-correct transition rates change during training? Does final accuracy improve without reducing early answerability?
- What happens if trajectories correct both early and finally receive at least as much reward as trajectories that recover from an early error, with all else fixed?
- Could the authors report response length and inference latency alongside accuracy for direct-answer Instruct, SFT-only, outcome-only GRPO, and the full method? A direct-answer baseline fine-tuned on the same QA data would further clarify the benefit of explicit reasoning.