- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ViB-OPD trains a video-language student with feedback from a stronger teacher on the student's own responses. The authors add two steps. Visual Evidence Mining (VEM) gives the teacher a sheet of 16 frames chosen for the question, in addition to the student's 32 frames. Boundary-Balanced OPD (BB-OPD) divides the student's reasoning into meaningful segments and slightly shifts the boundaries. The loss averages the token-level reverse KL within each segment, then gives each segment equal weight. At inference, the student uses its usual input.
Critical strengths
-
The authors check some obvious alternative explanations. In Figure 2, the teacher gets 32 frames plus a sheet of 16 frames in every setting. VEM scores 0.93 and 0.89 points above the uniform and random alternatives. Table 3 also compares different ways to group tokens, including random groups with matched lengths. I found these comparisons useful: they test whether choosing the frames and segments matters.
-
With 32 frames, both Qwen3-VL-8B and Qwen3.5-9B improve on all six benchmarks. The authors report using the same hyperparameters for the second model. The extra work happens during training, so the student needs no extra frames or modules at inference. That makes the gains useful even if the training is more expensive.
Critical weaknesses
-
I could not find the sources of the 1,000 training examples, how they were selected, or checks for shared videos with the benchmarks. Figure 3 compares settings on Video-MME without naming a separate development set. These details matter for assessing generalization.
-
Segment weighting adds one point on Video-MME (63.52% vs. 62.52%), mostly from shifting boundaries. I would like a paired comparison that accounts for questions from the same video, plus the same controls on other benchmarks. The authors do not directly test whether teacher errors decrease, and they do not report the extra cost of the evidence builder and 32B model.
Questions for authors
-
Where do the 1,000 training examples come from, and how did you choose them? Did you check for shared videos with each benchmark? I also could not tell which data you used to choose the checkpoint, the 10% boundary shift, and K=128.
-
Do the gains over VEM+Token and VEM+Semantic hold in a paired comparison that groups questions by video? I would be interested in the same comparisons on the other five benchmarks, since most of the evidence for the weighting comes from Video-MME.
-
Which tokens does the process mask keep? How do you shift the segment boundaries, and what happens when the model fails to divide the reasoning correctly? How much extra compute do the evidence builder and the 32B model need compared with ordinary OPD?