- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MUTE, a plug-and-play framework for lifelong audio-video test-time adaptation. It selects a teacher among audio, video, and fused prediction heads using entropy-based confidence and a modality-advantage criterion, and employs temperature-scaled KL mutual teaching with scheduled loss weighting. Experiments augmenting twelve base TTA methods on two datasets under audio and video corruption streams show varying degrees of improvement.
Critical strengths
The paper addresses an important challenge in lifelong multimodal test-time adaptation: modality reliability can vary under sequential distribution shifts, making adaptation vulnerable to error accumulation. Leveraging complementary predictions across modalities to improve adaptation reliability is a meaningful research direction.
Critical weaknesses
-
The theoretical risk bound relies on a key assumption that a sufficiently large confidence advantage implies a lower-risk teacher. Whether this assumption holds in the considered setting remains insufficiently justified.
-
The performance gains from MUTE vary substantially across experimental settings for the same baseline, particularly SURGEON. The authors' explanation is insufficient, and the claim that MUTE yields smaller marginal gains in already stable regimes is not consistently supported by the reported results.
Questions for authors
-
Could the substantial variation in SURGEON's performance gains across experimental settings be explained? In particular, why does it improve by 42.9 percentage points on KS50 video corruptions but only 0.1 points on each VGGSound corruption stream?
-
Could empirical evidence be provided to assess whether the confidence advantage reliably identifies the lower-risk teacher across audio, video, and fused heads under different corruption types?
-
Could MUTE's methodological novelty beyond existing confidence-based routing, mutual teaching, temperature scaling, and loss scheduling be clarified? Given that the current component ablation is limited to READ on KS50 video corruptions, how can the independent contributions of the proposed components be established?
-
All experiments use a single CAV-MAE backbone. Could the generalizability of MUTE to other multimodal backbones be further clarified?
-
In Appendix Tables 10 and 11, the per-corruption results for MEMO+MUTE appear nearly identical to those of the original CoTTA baseline. Could these entries be checked, and could any potential reporting errors affecting the reported average results be clarified?