- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes CAMA, a test-time cohort-level modality acquisition framework that allocates a fixed budget to acquiring one specified missing modality. Generative imputation estimates post-acquisition predictions, which guide sample selection to improve cohort-level AUROC or AUPRC.
Experiments on four datasets with up to 15 modalities demonstrate improvements over random selection and simple baselines in several settings.
Critical strengths
S1: The problem of allocating costly modality acquisitions under a limited budget is well-motivated and practically relevant.
S2: The proposed method shows promising improvements over random selection across several datasets.
Critical weaknesses
-
W1: Test-time information acquisition has been studied in EDDI [R1], while DyMo [R2] selects reliable recovered modalities at inference time. Their test-time selection and generative imputation alone are not new. The authors should clarify the methodological novelty arising specifically from cohort-level allocation.
-
W2: The evaluation excludes splits where full acquisition reduces test performance (Section 5). This conditions the results on outcomes unavailable before acquisition. Since additional modalities can introduce noise or conflicting signals [R3], such cases should be evaluated rather than excluded. Please report exclusion counts and unfiltered absolute performance.
-
W3: The acquisition functions mainly adapt established probability, entropy, and divergence criteria. Large KL divergence between pre-acquisition and imputed predictions may reflect unreliable imputation rather than useful acquisition. Stronger baselines, such as EDDI [R1] and DyMo [R2], and analysis of imputation reliability are needed.
-
W4: Sample-level visualizations could explain whether acquisition priorities predict realized benefits.
[R1] Ma, Chao, et al. "EDDI: Efficient dynamic discovery of high-value information with partial VAE." ICML 2019.
[R2] Du, Siyi, et al. "Inference-time dynamic modality selection for incomplete multimodal classification." ICLR 2026.
[R3] Dai, Yinglong, et al. "Analysis of multimodal data fusion from an information theory perspective." Information Sciences 2023.
Questions for authors
-
Q1: What is the methodological novelty compared with prior information acquisition and recovered-modality selection?
-
Q2: Do the conclusions hold when negative-gain splits are retained? How many splits are excluded?
-
Q3: Can the authors analyze whether KL-based priorities remain reliable under inaccurate imputation and compare against stronger acquisition baselines?
-
Q4: Could the authors visualize acquisition process for representative successes and failures?