- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes Gated Symile to improve multimodal contrastive learning under modality misalignment and missing inputs. Its candidate-conditioned gate selectively suppresses unreliable modalities through interpolation toward learnable neutral embeddings. Validation on synthetic and biomedical datasets demonstrates improved retrieval accuracy, particularly under misalignment and missing-modality conditions.
Critical strengths
The paper combines a clear robustness motivation with substantial empirical validation. Controlled misalignment experiments demonstrate the targeted failure mode, while improvements on biomedical retrieval datasets and extensive ablations support the practical value of adaptive modality gating.
Critical weaknesses
- Limited theoretical support: The robustness derivation assumes fixed gate weights and excludes the final normalization, although the proposed gate depends on the perturbed embedding. Consequently, the bound does not establish robustness for the implemented model, weakening a central theoretical claim.
- Insufficiently controlled comparisons: The gate introduces 44.1M additional parameters and candidate-conditioned scoring, but no genuinely parameter-matched baseline is provided. It therefore remains unclear whether the gains arise from reliability-aware suppression or increased capacity and scoring expressiveness.
- Limited validation of real-world robustness: The strongest misalignment evidence comes from synthetic data and deliberately permuted biomedical inputs. While useful controlled tests, these do not establish robustness to naturally occurring noise or conflicting evidence, limiting support for the paper’s broader robustness claims.
Questions for authors
-
Theoretical clarification: The robustness derivation holds gate weights fixed and excludes final normalization. Can the analysis account for both input-dependent gate variation and normalization, or should the robustness claim be restricted to the fixed-gate, pre-normalized setting?
-
Controlled comparison: Can you provide a parameter-matched, candidate-conditioned baseline without reliability-aware suppression? This would help distinguish the benefit of the proposed gating mechanism from additional capacity and scoring expressiveness.
-
Robustness clarification: Beyond deliberately permuted inputs, what evidence supports robustness to naturally occurring modality unreliability? Can the reported real-world gains be separated from improvements attributable to explicit missingness indicators?
With the rebuttal phase coming to an end, we thank the reviewer again for their time and feedback. Overall, the new results support our central findings.
We would be grateful if the reviewer could let us know whether any concerns remain before the rebuttal period ends.