- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies exemplar-free Audio-Video-Text Continual Learning. The goal is to continually extend the shared representation space of a pretrained audio-video-text model without storing historical samples, while preserving previously acquired knowledge and cross-modal alignment. The authors argue that existing low-rank continual adaptation methods mainly constrain the input side, which still leaves room for alignment drift on the output side. To address this, the paper proposes BiCLoRA, which imposes two-sided constraints on low-rank updates through a history-safe input basis and a frozen output basis, while only training the coupling kernel in between. The experiments show that the method consistently outperforms the compared LoRA-based baselines on FAA and BWT. The paper also supports its main claim with ablations, visualizations, and forgetting case analysis.
Critical strengths
- The problem setting is clear and well motivated. The paper focuses on exemplar-free AVT continual learning and clearly distinguishes this setting from visual CL, vision-language CL, and audio-visual CL.
- The method design matches the diagnosis of the problem. The paper identifies two failure modes, historical interference on the input side and alignment drift on the output side, and addresses them with the history-safe input basis and the frozen output basis respectively.
- The experiments and ablations are fairly convincing. Table 3 clearly shows that the input-side and output-side constraints are complementary. Removing either one leads to a noticeable drop in FAA and BWT, and removing both causes a large degradation. This provides solid support for the proposed method.
- The method is parameter-efficient. BiCLoRA uses only 128 trainable adaptation parameters per session while keeping a bounded persistent state, making it lighter than methods such as InfLoRA and KeepLoRA.
Critical weaknesses
- The novelty is more about a well-structured combination of mechanisms, while the theoretical support remains limited. The main contribution is to unify input-side protection and output-side freezing within one LoRA framework, but beyond the perturbation bound on the input side, the theoretical explanation for the output basis design is still relatively weak.
- The presentation of the baselines could be clearer. The appendix states that some baselines use matched implementations rather than their original forms. This helps isolate variables, but it also makes the fairness of the main comparison less transparent.
- The diversity of the continual learning tasks and the generalizability of the proposed method are somewhat limited. The current evaluation is limited to a classification-style AVT-CL setting, and the authors leave overlapping concepts, missing modalities, and broader distribution shifts as future work, so the generalizability of the method remains to be verified. And I feel that more forward-looking multimodal continual learning research should be conducted on MLLMs. Compared with classification tasks, validation in an MLLM setting would be more meaningful.
Questions for authors
See above
2 comments
Follow-up on our response, Reviewer MPzX
Thank you again for the positive assessment. Eq. 9 and Eq. 12 now give the output-side bound, Table 2 separates matched variants from original forms, and Sec. 5 states the scope of the evidence. As the discussion period closes today, we would be grateful for a short note on whether this addresses your concerns.
Response to Reviewer MPzX
Thank you for the positive assessment of the setting, complementary constraints and parameter efficiency. Changes are marked in blue in the revised PDF. The revision adds output-side analysis and direct controls while clarifying the scope of the evidence.
W1 Output-side explanation and contribution
For a historical input h=Pα+ϵ and a unit semantic direction w, Eq. (9) gives ∣w⊤ΔWh∣≤∥C⊤U⊤w∥2∥ϵ∥2.
The factors describe directional sensitivity and the residual outside the retained history. Orthonormal V makes the first coefficient equal to ∥ΔW⊤w∥2, directly comparable with a freely trained output map. Eq. (12) includes the normalization term needed for cosine similarity. The bounds characterize the output-side sensitivity; the choice of basis is tested directly in Table 8.
Table 8 supplies the complementary empirical evidence. At identical mean audio/video Frobenius norms of 0.22/0.31 on ImageBind SSW60, BiCLoRA has drift 0.020 and audio-video cosine 0.25, compared with 0.058 and 0.18 for matched D1. Across the four amplitude controls, the method retains 0.47 to 0.90 macro FAA and 0.66 to 1.34 BWT.
The larger-update test increases the kernel learning rate eightfold. Macro FAA/BWT falls to 71.43/-9.09, but at mean norms 1.18/1.65 its ImageBind SSW60 cosine/drift are 0.20/0.055. Default D1 has norms 1.08/1.54 and cosine/drift -0.13/0.380. Thus the alignment advantage does not depend on the update being small.
The methodological contribution is the asymmetric construction of the bases from historical inputs and current-session outputs. At the same 128 adaptation parameters, the data-derived output basis adds 0.89 FAA and 1.24 BWT over the random basis in Table 3.
W2 Baseline presentation
Table 2 explicitly separates matched-history InfLoRA at 69.08/-13.17 from the AVT transfer restoring its original history rule at 69.75/-11.32. BiLoRA achieves 69.78/-13.33. BiCLoRA reaches 72.21/-7.72 and improves FAA over BiLoRA in all nine settings and over original-history InfLoRA in eight. Appendix C specifies the common adaptation sites, optimization budget and classifier.
The revised abstract distinguishes FAA gains of 2.46 and 2.43 over these transfers from the 3.13-point matched-history gain. Appendix B.1 labels its shared-MLP LADA variant as a LADA-inspired feature-space control rather than a native-method reproduction.
W3 Scope and MLLMs
The common-classifier protocol enables controlled study of representation adaptation across disjoint-class, exemplar-free AVT streams. The tested setting uses paired audio and video with class-name guidance. Sec. 5 explicitly identifies overlapping concepts, missing modalities, broader distribution shifts and instruction-following MLLM streams as unevaluated extensions.
A compatible linear projector is a natural place to investigate the bilateral parameterization in an MLLM. Token-level objectives and downstream language-model behavior require separate evaluation. The current contribution is the bounded-state adaptation rule and its controlled AVT analysis, not an untested claim of MLLM generalization.