- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
READ is a training-free attribution method for VideoMamba classifiers. It unrolls the selective scan at the class-token readout, projects token contributions through a path-averaged class direction, and applies convolution correction and relevance reweighting. A streaming implementation accumulates contributions during one forward pass. Experiments on three video datasets and three VideoMamba sizes assess perturbation faithfulness, localization, sanity checks, and computational cost. The results show substantial memory savings and useful temporal localisation.
Critical strengths
The streaming implementation of the proposed READ provides a substantial practical benefit. On VideoMamba, the memory falls from 6.08 GB for fused MambaLRP to 3.47 GB. Comparing against an optimized MambaLRP implementation makes this result more convincing.
Critical weaknesses
It is unclear how the exact scan decomposition supports faithful attribution to the input video. READ fixes the input-dependent coefficients and treats the gate as a scaling factor, while using an approximation across blocks. Yet Table 4 shows that changing alone leading the prediction follows the original clip. This shows that the gate matters, but does not show that READ assigns relevance to the tokens that produced the gate.
Reducing first-frame relevance does not necessarily make an explanation more faithful. The model may rely more on the first frame. Eq.6 changes the temporal scores, but the first-frame and noise-input tests do not clearly separate model behaviour from the attribution bias. The results are also mixed: post-process produces lowers SSv2 temporal faithfulness, from 0.174 to 0.154 (Table 5).
Questions for authors
How does READ assign relevance to the video tokens that determine ? Could the Table 4 experiment also check whether the attribution map identifies those tokens, rather than only checking which clip dominate the prediction?
Can you test whether Eq.6 removes attribution bias while preserving a real model preference for the early frames? Were the post-processing settings chosen using clips separate from the final evaluation?
Follow-up on Remaining Concerns
Dear Reviewer HwoZ,
Thank you for your time and effort. Two other reviewers have responded positively to the authors' rebuttal, but there is still a discrepancy in the current assessments.
Could you please clarify whether the authors' responses have adequately addressed your concerns? If any concerns remain, we would appreciate it if you could elaborate on them to help facilitate further discussion and reach a more informed consensus.
Thank you for your time and consideration!
Best regards,
Area Chair