- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates Teacher–Student Observation Mismatch in video reasoning distillation and proposes a framework combining SFT, Multi-Observation GRPO (MO-GRPO), and Execution-Aware Reference Regularization (EARR).
Critical strengths
The paper presents a clear and well-organized experimental evaluation across multiple Video-LLM backbones and six benchmarks. The observation-sensitivity analysis also highlights a relevant challenge in video reasoning.
Critical weaknesses
Motivation–method mismatch. The paper argues that teacher and student models observe different video frames, but MO-GRPO only optimizes student-generated trajectories under different sampling configurations. It is unclear how this directly addresses the proposed teacher–student mismatch. The SFT part includes, but from the ablation, it does not perform well (performance degradation on Qwen3-VL).
Insufficient analysis of MO-GRPO. The paper does not convincingly explain why multi-observation training improves reasoning beyond ordinary temporal data augmentation.
Limited ablation evidence. MO-GRPO does not consistently outperform standard GRPO. Moreover, the missing GRPO + EARR baseline makes it difficult to isolate the contribution of MO-GRPO.
Questions for authors
- Can the authors experimentally validate the impact of matched versus mismatched teacher–student observations?
- Why does MO-GRPO improve performance beyond standard temporal data augmentation?
- How does standard GRPO + EARR perform compared with the full method?
4 comments
Weakness 2 / Question 2: Why does MO-GRPO improve beyond ordinary temporal augmentation?
On its own it does not, and this is the point. Training on several views under one uniform constraint is temporal augmentation in the RL setting, and it brings no gain over single-view GRPO: 54.35 against 55.16 on the Fig. 5 average, and 50.69 and 52.52 at the two other constraint strengths we tested (β = 0.001 and 0.005).
The gain comes from what augmentation does not do: treating the views of the same question differently. Augmentation regards views as interchangeable samples. Our method regards each view as a separate execution condition and sets the constraint to the SFT prior per view, according to whether that prior answers correctly under it. This matters because the prior is acquired under one sampling configuration and is less reliable under others (in Table 2 the SFT model scores 53.75 and 52.50 at 1 FPS, against 60.12 at 2 FPS, φ = 0), so a uniform constraint ties the policy to the prior even where it fails. With per-view control the average rises to 56.31; assigning the same two coefficients to views at random brings it back to 54.26. Multi-observation training is what exposes these per-view differences, and EARR is what uses them.
Weakness 3 / Question 3: MO-GRPO does not consistently outperform standard GRPO. How does standard GRPO + EARR perform compared with the full method?
GRPO + EARR is below the full method on all three benchmarks: 64.38 vs. 66.50 on TimeBlind, 66.25 vs. 67.47 on MVBench and 34.02 vs. 34.97 on TOMATO, or 54.88 vs. 56.31 on average. The full ablation, including the new controls, is given below (accuracy in %, Qwen3-VL-4B-Thinking; all Stage-II variants start from the same Stage-I SFT checkpoint).
| Stage II | Reference KL | TimeBlind | MVBench | TOMATO | Avg. |
|---|---|---|---|---|---|
| SFT | - | 60.12 | 62.00 | 24.30 | 48.81 |
| + GRPO | const 0.003 | 65.87 | 66.00 | 33.62 | 55.16 |
| + GRPO | EARR | 64.38 | 66.25 | 34.02 | 54.88 |
| + MO-GRPO | const 0.001 | 66.62 | 65.25 | 20.21 | 50.69 |
| + MO-GRPO | const 0.003 | 62.88 | 66.12 | 34.06 | 54.35 |
| + MO-GRPO | const 0.005 | 62.50 | 64.75 | 30.32 | 52.52 |
| + MO-GRPO | shuffled EARR | 65.38 | 66.13 | 31.26 | 54.26 |
| + MO-GRPO | EARR (ours) | 66.50 | 67.47 | 34.97 | 56.31 |
This table isolates the contribution of each component. We agree that MO-GRPO alone does not outperform GRPO (54.35 vs. 55.16), and EARR alone does not either (54.88 vs. 55.16). The contribution is their combination: adding multi-observation training to EARR raises the average from 54.88 to 56.31, and adding EARR to multi-observation training raises it from 54.35 to 56.31. EARR sets the constraint per view, so it needs the several views of each question that only multi-observation training provides (see W2/Q2).
The remaining rows rule out the alternative explanations. The gain is not a matter of constraint strength: no constant coefficient reaches the full method's average (50.69, 54.35 and 52.52 for β = 0.001, 0.003 and 0.005), and EARR's mean coefficient in the single-observation run is 0.00325, close to the constant 0.003. Nor is it a matter of mixing two strengths: assigning EARR's two coefficients at random gives 54.26, on par with the constant baseline. Only matching the coefficient to the reference outcome under each view produces the gain.
Looking forward to your feedback
Dear Reviewer 4EqY,
Thank you again for your review. We posted our response on 13 Nov, with a new experiment for each of your three questions.
Could you let us know whether it addresses your concerns, in particular on soundness? If anything remains open, we would like to resolve it while the discussion period is still running. If your concerns are addressed, we would appreciate it if you could update your assessment.
Best regards,
The Authors
Kind Follow-up on Our Rebuttal and Additional Experiments
Dear Reviewer 4EqY,
We would like to kindly follow up on our previous rebuttal, where we provided additional experiments addressing all three of your questions, particularly the concerns regarding the soundness of our method.
As the discussion period is approaching its end, we would sincerely appreciate your feedback on whether these additional results address your concerns. If so, we would be grateful if you could reconsider your assessment.
Thank you very much for your time and consideration.
Best regards,
The Authors
Thank you for your careful review. We answer each question below and have uploaded a revised PDF with the changes marked in blue. Table and section numbers refer to the revised PDF.
Weakness 1 / Question 1: Motivation–method mismatch; matched vs. mismatched validation
We ran the matched-versus-mismatched experiment. Teacher and student are from the same family (Qwen3-VL-235B-A22B-Thinking and Qwen3-VL-4B-Thinking), so the observation is the only factor that varies; the student always receives 2 FPS, φ = 0. When the teacher receives the same frames, SFT keeps the student's accuracy on TimeBlind (64.50 → 65.43). When only the teacher's phase is shifted to φ = 0.5, with everything else identical, SFT lowers the student to 53.88. The mismatch alone accounts for an 11.55-point difference.
This also clarifies how the method addresses the mismatch. It does not try to align the student with the teacher's frames, because a black-box teacher does not expose them: we send the video, and which frames it reads is internal. Instead, Stage II removes the student's dependence on the teacher's observation. The student generates trajectories from its own observation and is rewarded by the task outcome, so the mismatched target is no longer in the objective. We use multiple observations for the same reason: since the teacher's frames are unknown, we cannot know where a given student observation departs from them, so the student is trained to execute correctly under several observations rather than one.
The results match this account. In the black-box setting, SFT leaves the student below the pretrained model under all five observations in Table 2 (mean 56.80 vs. 62.03), and the full method brings it above the pretrained model under all five (mean 65.65).
Weakness1 (cont.): Why keep Stage-I SFT when it degrades Qwen3-VL?
Stage I is not kept for its standalone accuracy. It supplies the prior that Stage II turns into accuracy, and Stage II does not work without it: multi-observation RL from the pretrained model reaches 51.98, below the pretrained model itself (54.38), whereas the same RL from the SFT checkpoint reaches 54.35 and is higher on all three benchmarks, and 56.31 with EARR (Fig. 5).
The drop after SFT is also not a failure of SFT. Our controlled experiment shows that it comes from the observation mismatch: with identical teacher and student frames SFT keeps the student's accuracy (64.50 → 65.43 on TimeBlind), and with shifted teacher frames it falls to 53.88. A black-box teacher does not let us remove this mismatch, so SFT alone pays its cost, and that is exactly why Stage II follows it. The degradation is the observation the paper starts from, not a flaw in the pipeline.