acceptodds
Under review as a conference paper at ICLR 2027

Bridge the Gaps: Gap-Aware Preservation and Expansion for Continual Missing Modality Learning

Abstract

Continual Missing Modality Learning (CMML) requires multimodal models to learn new classes sequentially while retaining old knowledge under incomplete visual or textual inputs. Existing methods mainly recover missing information or reduce interference through efficient adaptation and knowledge preservation, but overlook how missingness alters cross-modal relations before and after fusion. Our stage-wise analysis reveals two coupled challenges: compensated features obscure degradation of the real image-text geometry before fusion, while shared fusion under unequal modality reliability induces misleading modality dependencies after fusion. To address them, we propose GAPE, a Gap-Aware Preservation and Expansion framework. GAPE separately monitors real geometry degradation and compensation-induced shifts to select a safe adaptation stage, and combines counterfactual anchoring, confidence, and modality availability to calibrate fused decisions toward reliable evidence. Experiments on two CMML benchmarks show consistent state-of-the-art performance across diverse missing patterns and ratios.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.