- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes EventWorth, a risk-controlled framework for selectively using event-camera information in temporally causal video prediction. The main motivation is that event streams can improve prediction under challenging conditions, such as fast motion and low illumination, but unreliable events may instead degrade performance.
To address this issue, the authors employ a frame-only predictor and an event-assisted predictor and learn baseline-relative gain and harm scores using paired supervision from delayed future visual anchors. Based on these scores, a selection policy determines when event information should be used. The proposed framework further incorporates an independent statistical certification procedure based on Clopper–Pearson confidence bounds to control the risk of harmful event usage. If certification fails, the system falls back to the frame-only predictor.
Experiments on the RLED dataset show that EventWorth selectively uses event information while reducing harmful predictions and maintaining prediction gains.
Critical strengths
-
The paper addresses a practically relevant issue in event-assisted video prediction, where unreliable event information may degrade prediction quality compared to a frame-only baseline.
-
The proposed framework incorporates an independent risk certification procedure to control harmful event usage, providing a principled approach to selective event-based prediction.
Critical weaknesses
-
Unclear practical motivation and significance. While the paper formulates selective event usage as a risk-control problem, the practical importance of this task is not sufficiently justified. In particular, the paper lacks concrete application scenarios or downstream evaluations demonstrating why such a selection framework is necessary.
-
Limited technical novelty. The proposed method largely combines existing techniques, including gain/harm-based modality selection, threshold-based gating, and standard statistical risk certification. The technical contributions beyond applying these established concepts to event-assisted video prediction remain unclear.
-
Restrictive theoretical assumptions. The risk-control guarantee relies on a round-level i.i.d. assumption, which may not hold for temporally correlated video data. This limits the applicability of the theoretical guarantees to realistic video prediction scenarios.
Questions for authors
-
Could the authors clarify the practical applications of the proposed framework? In particular, what real-world scenarios would benefit from selectively switching between frame-only and event-assisted video prediction?
-
Could the authors further clarify the key technical contributions of EventWorth beyond existing modality selection and statistical risk certification methods?
-
Why does the proposed framework show substantially weaker results with learned predictors compared to analytic predictors? Could the authors provide additional experiments with stronger event-based video prediction models to demonstrate its generalizability?