- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes Learning from Reliable Latent Prompts, a prompt-learning framework for visual recognition under missing-modality scenarios. The main motivation behind this work is that existing input-conditioned prompting methods rely on potentially incomplete or unreliable modality features, which can negatively affect prompt learning. The proposed method introduces input-independent, modality-specific learnable prompts that are transformed into latent anchors. A cross-modal co-adaptation mechanism uses bidirectional cross-attention between these anchors to generate dual anchor-induced prompts, which are concatenated with the original anchors and injected into the frozen CLIP image and text encoders. The method is evaluated on different image-text benchmarks under various missing-modality scenarios, and the authors report improvements over the selected baselines. Ablation studies are also provided to evaluate the effectiveness of the proposed components.
Critical strengths
-
The paper shows strong experimental performance, as the proposed method outperforms the selected baselines across different missing-modality scenarios.
-
The proposed method is relatively simple and does not require explicit reconstruction of missing modalities.
-
The paper is well written, organized, and easy to follow.
Critical weaknesses
-
The proposed method relies on input-independent latent anchors that are shared across samples and are not conditioned on the available modality content. Although these anchors interact with the actual input features through self-attention within the CLIP encoders, the cross-modal co-adaptation mechanism itself operates only on the learned anchors and does not adapt the generated prompts to instance-specific semantics. While the authors claim that these anchors provide semantic compensation for missing modalities, it remains unclear how input-independent prompts can compensate for different missing information across samples. Therefore, it is difficult to determine whether the reported improvements result from meaningful cross-modal semantic compensation or general prompt-based adaptation. The provided experiments and ablation studies do not directly validate this claim or establish whether input-independent anchors are preferable to prompts conditioned on the available modality features.
-
The paper does not evaluate the performance of the proposed method under a 100% missing rate, where all samples have only one available modality (either text or image). Given the authors' argument that input-independent latent anchors learn stable modality-level priors that can compensate for missing information, it would be important to evaluate how the method performs when an entire modality is unavailable across all samples.
-
The paper is missing comparisons with several relevant methods that address the same missing-modality problem. Some of the works that are not included are:
-
Lu et al., "DPL: Decoupled Prototype Learning for Enhancing Robustness of Vision-Language Transformers to Missing Modalities," CVPR, 2026
-
Zhao et al., "Enhancing Multimodal Model Robustness Under Missing Modalities via Memory-Driven Prompt Learning," IJCAI, 2025
-
Pipoli et al., "Semantically Conditioned Prompts for Visual Recognition under Missing Modality Scenarios," WACV, 2025
-
Nezakati et al., "MMP: Towards Robust Multi-Modal Learning with Masked Modality Projection," IEEE BigData, 2025
-
Reza et al., "Robust Multimodal Learning via Cross-Modal Proxy Tokens," TMLR, 2025
Questions for authors
-
The authors claim that the learned anchors capture meaningful modality-specific information, but how is this demonstrated? It is unclear whether these anchors actually encode information specific to each modality or simply function as generic learned prompts that improve classification performance. What evidence supports the modality-specific nature of these anchors?
-
The authors argue that input-independent prompts are more reliable than input-conditioned prompts. However, when one modality is missing, the other modality is still available and contains useful semantic information. What justifies not using this information during prompt generation? The current comparisons do not clearly establish whether input-independent anchors are more effective than using the available modality features.
-
The experiments focus on classification tasks using image-text datasets. How well would the proposed method generalize to other downstream tasks, such as visual question answering, if the learned anchors in fact capture meaningful modality-specific information? The current evaluation does not establish whether these anchors would remain effective beyond classification.