- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Event-Grounded Self-Distillation (EGSD) for streaming video understanding, addressing optimization misalignment and effective-entity memory collapse when applying conventional on-policy self-distillation to streaming memory. EGSD introduces Event-based supervision consisting of visual entities, actions, and details. It incorporates these facts into a privileged teacher and introduces an entity-coverage reward to encourage diverse and grounded memory. Experiments on five benchmarks, including StreamingBench, OVO-Bench, and Video-MME, using Qwen2.5-VL-7B and Qwen3-VL-8B demonstrate improvements in memory-dependent understanding. Memory analyses further show increased entity recall with limited memory-length overhead.
Critical strengths
S1. Well-motivated problem formulation and targeted memory supervision.
The paper identifies meaningful challenges in applying self-distillation to streaming video, particularly the degradation of effective-entity coverage. Its main contribution lies in introducing Event-grounded teacher supervision and an explicit entity-coverage reward. These designs directly address the identified problem and provide a meaningful extension to existing self-distillation methods.
S2. Comprehensive experiments with convincing empirical evidence.
The evaluation covers two backbone models and multiple online and offline benchmarks, with comparisons against relevant baselines. The ablation studies support the effectiveness of Event supervision, while the memory analyses demonstrate improved entity recall with modest additional memory overhead. These results provide evidence that the proposed method improves memory quality rather than merely increasing memory length.
S3. Clear presentation and illustrative case studies.
The paper is well organized and clearly written, with a coherent logical structure and informative, visually appealing figures. In addition, the case studies in the appendix provide intuitive explanations of how the proposed method preserves important visual information and improves downstream reasoning. These elements make the methodology and its benefits easy to understand.
Critical weaknesses
W1. Incomplete formulation of the optimization objective.
Equation (9) does not explicitly present the policy probability ratio required by the PPO/GRPO-style surrogate objective, making the actual gradient computation unclear. Additionally, the entity-coverage reward in Equation (11) differs from the precision-slack formulation in Appendix D.3. These inconsistencies affect technical clarity and reproducibility, although they appear potentially straightforward to resolve.
W2. Clarification of methodological contributions.
The multiplicative weighting mechanism has already been introduced in RLSD and therefore should not be considered a novel contribution of this paper. More precisely, the contributions of EGSD lie in maintaining non-decaying teacher guidance, modifying the content of self-distillation through Event-grounded supervision, and introducing an explicit reward for memory coverage. Nevertheless, I consider the insights and task-specific adaptations presented in this paper valuable.
W3. Ambiguity regarding question-independent Event supervision.
The paper motivates Events as question-independent facts, while the Event extraction prompt in Appendix D appears to incorporate the future question. Although this does not violate the student's causal inference protocol, it leaves some ambiguity regarding the extent to which Event supervision is independent of question relevance.
Questions for authors
-
Could the authors provide the complete optimization objective for Equation (9), explicitly specifying the policy ratio, clipping operation, and stop-gradient treatment? Please also clarify the difference between Equation (11) and the implementation in Appendix D.3.
-
Could the authors clarify how the proposed multiplicative teacher guidance differs from RLSD, particularly regarding the non-decaying weighting strategy, and more explicitly distinguish the inherited components from the novel contributions?
-
To what extent does the future question influence Event extraction? How should the claim of question-independent Event supervision be interpreted given the extraction prompt in Appendix D?
Thank you very much for the careful check of our formulation, which caught two places where the paper and the implementation do not match. The revision fixes both, and we answer each point in detail below.
W1 & Q1: the complete objective, and Eq. (11) against D.3
A. You are right that Eq. (9) omits the policy ratio and the clipping. It was written in abbreviated form. In the implementation, the teacher-weighted advantage A^t of Eq. (8) enters a standard PPO clipped surrogate with the same averaging as Eq. (9),
Lteacher=−E[G1∑i=1G∣y(i)∣1∑t=1∣y(i)∣min(rtA^t(i), clip(rt,1−ϵl,1+ϵh)A^t(i))],rt=πθold(yt)πθ(yt)
with ϵl=0.2 and ϵh=0.28 and no KL term. The coverage branch uses the same surrogate with Amem in place of A^t, restricted to memory-writing tokens. The total objective is Eq. (12) with λ=0.5 and βw=0.3, and the revision writes Eq. (9) out in this form with the remaining details in Appendix D.
On Eq. (11), the ratio gk of Eq. (10) is the zero-slack special case, while the implementation uses the slack precision of Appendix D.3, which exempts a small number of unmatched student entities before penalizing the rest. The slack of 0.5 printed in D.3 is a typo and the value used throughout is 0.25. The revision aligns Eqs. (10) and (11) with D.3 and corrects it.
W2 & Q2: what is inherited from RLSD and what is new
A. We agree, and the revision makes the boundary explicit. What EGSD inherits from RLSD is the sign-modulated multiplicative weight and its clipping, as noted in Sec. 3.2.2. Four things are new:
Table 3 separates these increments on Qwen3-VL-8B: removing the decay raises the OVO average by 0.4, Event privilege by 2.0 and the coverage reward by a further 0.8. Only the weight form is inherited; the diagnosis, the non-decaying gate, the Event-privileged teacher and the coverage reward are this paper's contributions.
W3 & Q3: the influence of the future question on Event extraction
A. We agree that the original Event extraction uses the future question for fact prioritization, rather than being strictly question-independent. However, all extracted facts must be grounded in the observed clip, and the question must not introduce unobserved content. We have clarified this distinction and printed the prioritisation rules of both extractors in Appendix D.
To assess whether question-guided prioritization is necessary, we additionally evaluate a question-free extractor as a controlled ablation, while retaining the original configuration for the main experiments. The two variants share 91.4% of extracted entities. Rows 1-3 below are the paper's Qwen3-VL-8B results and row 4 is EGSD retrained on question-free facts.
Downstream performance is comparable, with every change within 1.1 and a seven-benchmark average of 62.91 against 62.84. EGSD's improvements therefore do not require question-guided Event selection. The recall analysis under question-free references is given in our response to Reviewer Svrj.