- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper formalises the view that auxiliary modality utility is not an intrinsic property of the modality but is residual to what the primary representation has already captured. The authors introduce three carefully separated estimands, Incremental Modality Gain (IMG), cross-modal predictability (RS), and Residual Modality Utility (RMU), and design a matched low-capacity, cross-fitted estimation protocol to evaluate them without capacity confounds. Across three deliberately heterogeneous representation-level ladders and an independent seven-backbone clinical sweep with exact Shapley values, the paper demonstrates that (i) realised gain concentrates at weaker or less task-adapted representations and collapses toward zero at stronger ones, (ii) high cross-modal predictability does not imply conditional sufficiency and can even be negatively associated with gain, and (iii) RMU tracks realised IMG across domains (pooled seed-cluster bootstrap Spearman ρ = 0.651, 95% CI [0.483, 0.825]) while surviving shuffle, missingness, and capacity controls.
Critical strengths
-
Novel and well-motivated conceptual framing. The explicit separation of signal redundancy (RS) from target-relevant residual utility (RMU), illustrated by the constructive DGP in Eq. 3 where RS → 1 yet gain remains strictly positive, corrects a widespread conflation in the multimodal literature and provides a genuinely useful diagnostic lens.
-
Exceptional methodological rigour. The matched low-capacity ridge head protocol, K = 5 cross-fitted residuals, validation-only penalty selection, and pre-specified go/no-go gate collectively eliminate the most common confounds in modality-contribution evaluation (capacity leakage, in-sample overfitting, post-hoc cherry-picking). The signed reporting rule (negative cells kept, no truncation) is commendable.
Critical weaknesses
-
Figure 1 provenance concerns. The schematic's visual style, uniformly smooth gradients, perfectly symmetric layout, and a highly polished "generated-diagram" aesthetic raises the question of whether it was produced or heavily assisted by a generative image model. The current Generative-AI use statement (Appendix K) limits AI use to "language polishing, grammatical correction, and improvements to clarity and readability," which would not cover figure generation. I ask the authors to clarify how Figure 1 was created; if any generative tool was involved beyond layout assistance, the disclosure should be updated accordingly, and the authors should verify that no text or notation in the figure contains rendering artefacts typical of such tools.
-
RMU is bounded by the linear probe's expressiveness. Any target-relevant residual structure that is non-linear in the auxiliary residuals will be missed. The small-MLP probe result (pooled ρ = 0.291) and ElasticNet failure (0.033) suggest the diagnostic is fragile outside the linear family, a narrower applicability than the framing implies. A dedicated synthetic experiment quantifying the non-linear failure boundary would strengthen the limitations discussion.
Questions for authors
See the Critical Weaknesses part.