- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes MeSD, a multi-evidence self-distillation framework for VideoLLM post-training, addressing three problems: (i) sequence-level rewards provide limited token-level guidance; (ii) a single teacher context fails to capture cross-evidence agreement and conflict among heterogeneous evidence; and (iii) failed trajectories lack corrective supervision. To this end, the authors follow the on-policy self-distillation paradigm, using an EMA self-teacher conditioned on privileged annotation information. Existing dataset annotations (semantic answers, keyframe timestamps, and object bounding boxes) are organized into three evidence-conditioned teachers — Answer, Answer-Temporal, and Answer-Spatial. Using the Answer Teacher as a semantic anchor, the method measures the token-level preference shifts induced by temporal/spatial evidence, decomposes them into teacher-common preferences and teacher-specific residuals, and fuses them into a single target distribution via dual gating (an agreement gate and a magnitude gate). The motivation for evidence separation is presented clearly overall, and the framing of the pain point — that aggregating evidence in a single teacher context obscures evidence-specific contributions and conflicts — is well defined. The paper further proposes Verification-Guided Optimization: a task-specific verifier classifies student trajectories into Success, Failure, or Indeterminate; for successful and indeterminate trajectories, reward-derived signs are preserved during token-level advantage refinement; only for verified failures with the required evidence is the GRPO policy loss replaced with a reverse-KL objective, thereby providing corrective supervision even when group-relative advantages vanish. The paper presents a systematic experimental study across multiple benchmarks, including component ablations, comparisons of correction selection strategies, and multi-scale generalization experiments on Qwen3-VL 4B/8B/32B, concluding that MeSD consistently outperforms RLVR, RLSD, OPSD, VISD, and other baselines, while reporting a 65.8% reduction in training time relative to VISD.
Critical strengths
-
The ablations form a complete and coherent chain: w/o ES → w/o GPA → MeSD progressively isolates the independent contributions of "evidence separation" and "gated fusion"; w/o FCD and w/o VGO separately disentangle the value of the two optimization branches; and the correction selection strategies (Verified strict / All / Random) constitute a controlled comparison at a fixed correction-set size, directly testing the effectiveness of restricting correction to verified failures.
-
The paper formalizes the vague issue of "a single teacher context obscuring evidence contributions" into a well-defined decomposition of preference shifts (teacher-common preferences vs. teacher-specific residuals), and formalizes "limited corrective guidance for failed trajectories" as the vanishing-gradient problem of multiplicative refinement when group-relative advantages are zero, offering a principled account of how the reverse-KL objective bypasses this dead zone.
Critical weaknesses
-
The entire motivation rests on the claim that "sequence-level rewards offer limited token-level guidance," yet the paper lacks a direct comparison between sequence-level rewards alone (standard GRPO) and the addition of token-level supervision. If this premise does not hold, the entire complexity of the framework amounts to over-engineering. This is decisive for my overall assessment: even though the ablations are thorough, they only demonstrate that "individual components contribute within this design," not that "this design is the right abstraction for the problem."
-
MeSD involves three teacher distributions per position (roughly 3x teacher forward passes, with an implicit ensemble effect), whereas w/o ES performs only a single teacher forward pass. The two are not matched in terms of compute or distributional diversity. The paper provides no compute-matched baseline, does not test the key variant of "three contexts each containing all evidence" (i.e., separating the contexts without splitting the evidence), and does not evaluate stronger single-context prompting for conflict resolution (e.g., prompting the teacher to explicitly compare evidence consistency before producing its distribution).
Questions for authors
-
Please provide (or point to) a comparison under identical settings between standard GRPO (without any token-level refinement/distillation) and the full token-level supervision. If the gap is small, the necessity of the entire evidence-separation-and-fusion structure would be fundamentally challenged.
-
Please report an experiment with a multi-teacher variant where all three contexts contain all evidence and the resulting distributions are fused, serving as a compute-matched baseline for MeSD. Additionally, please clarify how the evidence fields were organized in the single-context baseline (ordering, label formatting), and whether a stronger single-context prompt asking the teacher to explicitly compare cross-evidence consistency before producing its distribution was attempted. This directly determines whether the core novelty claim stands.
-
Is there ablation support for routing Indeterminate trajectories to the credit refinement branch rather than the failure correction branch?
-
Are the numbers in the main tables and ablation tables from single runs? Please report the mean ± standard deviation over multiple random seeds for the key comparisons (MeSD vs. VISD, MeSD vs. w/o ES, Verified vs. All). In particular, are the small margins such as VideoMMMU Overall (56.1 vs. 55.8) within the noise range?
Suggestion for future work (does not affect the rating): Compare learnable evidence fusion mechanisms (e.g., learned gating or attention-based weighting) against the current handcrafted geometric/arithmetic decomposition with dual gating, and examine at larger model scales whether the marginal benefit of evidence separation diminishes as unified understanding capabilities strengthen. This would address the open question of whether the handcrafted structure is merely transitional scaffolding, but it is beyond the scope of the present paper.
Overall Response
We sincerely thank all three reviewers for their careful reading and constructive feedback. We appreciate their recognition of the motivation for separating temporal and spatial evidence to understand how each shapes token preferences (@J6NH, @6AuX), the gains on video question answering and grounding benchmarks (@mTtU, @6AuX), and the ablations examining evidence separation, fusion, and failure correction (@mTtU, @J6NH, @6AuX). Their feedback helped us clarify how fusion and correction interact during training (@mTtU), distinguish the benefit of evidence separation from the effects of prompting and teacher computation (@J6NH), and assess the choice of fusion rule and the quality of supervision on failed trajectories (@mTtU, @6AuX).
At the core of our work is the use of multiple sources of video evidence to guide token-level learning in VideoLLMs. A sequence-level reward offers little guidance on which token predictions should change, while combining all annotations in a single teacher context obscures where temporal and spatial evidence agree or conflict. MeSD uses the Answer Teacher as a common reference to measure how each source of evidence changes predictions on the same student-generated prefix, then fuses shared preferences with a gated contribution from evidence-specific preferences. Guided by verification, MeSD applies direct distribution-level correction to eligible failures while preserving the direction of reward-based updates on other valid trajectories. MeSD thus turns existing answer and grounding annotations into targeted supervision, improving performance across video understanding and spatiotemporal reasoning benchmarks.
We have responded to each reviewer’s comments and incorporated the key control experiments into the revised manuscript. Following the discussion, @J6NH and @6AuX both indicated that their main concerns had been addressed and raised their ratings from 2 to 3 (Weak Accept). The revisions cover four main areas.
Evidence separation and training cost. Table 6 compares MeSD with three controls using the same available evidence: a single all-evidence context, the same context with a stronger consistency instruction, and three contexts with different evidence orders. All configurations share the same initialization, training data, annotations, and training steps. We report teacher scoring passes and full training time alongside performance.
Answer reference and adaptive fusion. Section 3.2 clarifies how the Answer Teacher provides a common reference for samples with different combinations of annotations. Table 5 tests the reference and the gate separately. One control replaces the answer reference with the student distribution. The others compare adaptive gating with geometric, arithmetic, and fixed-weight fusion while keeping teacher evidence and trajectory selection fixed.
Failure selection and correction. We clarify that reverse-KL correction applies only to verified failures that meet the strict eligibility criteria and have the required teacher evidence. Other valid trajectories retain reward-based credit refinement. With correction counts matched by task and batch, strict selection improves V-STAR mLGM by 4.6 points and TVGBench mIoU by 3.4 points over random selection. Table 15 separates the contributions of failure correction and credit refinement. Appendix F.5 defines how to measure, for each task, the share of valid trajectories that have both auxiliary evidence types, exhibit teacher disagreement, and receive correction.
Teacher-target quality and stability across runs. Table 14 compares the probabilities that teachers and students assign to ground-truth answer tokens on identical failed prefixes. We also examine sensitivity to perturbations of temporal annotations and report three-seed results for selected comparisons in Table 16. We appreciate @J6NH’s suggestion to extend the multi-seed analysis to Verified versus All.
We have revised the main text and appendix in response to the reviewers’ feedback. Tables 5 and 6 now include the key control experiments, and the appendix provides supporting analyses. We have highlighted the revisions in blue. We sincerely thank the reviewers for helping us improve the paper.