- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses medical image segmentation with incomplete image, text, and mask information during training. OT-MIMIC uses Fused Gromov–Wasserstein transport and a memory bank to connect incomplete samples with complete cases, then recovers missing representations or masks by barycentric aggregation. Experiments on QaTa-COV19 and MosMedData+ cover both missing-text and missing-image-and-mask settings, together with ablation and cross-domain results. The paper also presents an excess-risk analysis for a parametric transport formulation and discusses the difference between this theoretical setting and the POT-based implementation used in the experiments.
Critical strengths
- OT-MIMIC provides a unified way to use samples with missing image, text, or segmentation supervision. The same transport mechanism is used to recover both missing representations and missing masks, which makes the framework more general than methods built for a single missing-data pattern.
- The method makes direct use of incomplete records instead of simply discarding them or relying on a separate modality generator. The transport-based completion provides a clear way to recover missing information from the distribution of complete cases.
Critical weaknesses
- The theoretical guarantee is derived for a parametric completion map with independent sample splitting. The main POT implementation is non-parametric, updates the memory bank across epochs, and uses the same training records for completion and ERM, so the theorem does not directly apply to the reported system.
- The missing-data settings are created from fully paired datasets under MCAR. In the missing-image-and-mask setting, many samples become text-only records, which may be quite different from the missingness patterns seen in real clinical data.
- The uncertainty-based memory-bank update is presented as an important part of OT-MIMIC, but its effect is not isolated. The current ablations mainly vary the bank size and the completion rule.
Questions for authors
- How much does the uncertainty-based bank update contribute when the bank size and FGW completion rule are kept fixed? Is there a matched result without uncertainty ranking?
- How does OT-MIMIC behave when the missingness is not MCAR, especially when image or mask availability depends on the clinical case?
4 comments
Response to Reviewer Cqa4 — Part 2/2 (continued)
2. Beyond MCAR: lesion-burden-dependent MNAR (Q2, W2)
We agree that MCAR does not capture clinically dependent missingness patterns. We therefore construct the lesion-burden-dependent MNAR setting used in both the memory-selection ablation above and the following comparison. Since the datasets do not provide clinical severity labels, we use lesion area fraction as a proxy for lesion burden. Specifically, lesion burden is defined as the fraction of pixels labeled as lesion in each ground-truth mask after resizing to 224 × 224 and binarization at a threshold of 0.5.
To simulate lesion-burden-dependent MNAR, we sample complete training cases without replacement using weights proportional to , where is the standardized lesion burden (). Thus, cases with larger lesions are less likely to retain their images and masks, while their text remains available. All methods use identical missingness splits, and validation and test sets remain unchanged. Because the selection probability depends on lesion burden computed from ground-truth masks that are subsequently withheld, this setting simulates MNAR by making image-and-mask availability depend on lesion information that is unavailable in the resulting incomplete records. Lesion burden is used only to generate missingness and is never provided as a model input.
We compare OT-MIMIC with GuideSeg, the best-performing baseline in Table 2, under simulated lesion-burden-dependent MNAR.
Simulated lesion-burden-dependent MNAR · Dice
| Dataset | Complete | OT-MIMIC | GuideSeg |
|---|---|---|---|
| QaTa-COV19 | 50% | 0.904 | 0.888 |
| QaTa-COV19 | 25% | 0.894 | 0.866 |
| QaTa-COV19 | 10% | 0.842 | 0.854 |
| QaTa-COV19 | 5% | 0.825 | 0.818 |
| QaTa-COV19 | 1% | 0.714 | 0.675 |
| Kvasir-SEG | 50% | 0.876 | 0.818 |
| Kvasir-SEG | 25% | 0.814 | 0.775 |
| Kvasir-SEG | 10% | 0.759 | 0.733 |
| Kvasir-SEG | 5% | 0.791 | 0.682 |
| Kvasir-SEG | 1% | 0.535 | 0.423 |
Under simulated lesion-burden-dependent MNAR, OT-MIMIC achieves higher Dice than GuideSeg in 9 of the 10 evaluated settings, including all five ratios on Kvasir-SEG. At 1% availability, OT-MIMIC achieves Dice scores of 0.714 versus 0.675 on QaTa-COV19 and 0.535 versus 0.423 on Kvasir-SEG, corresponding to improvements of 0.039 and 0.112, respectively. These results indicate that OT-MIMIC retains a comparative performance advantage under the simulated MNAR mechanism. This controlled experiment evaluates one hypothesized direction of lesion-burden-dependent selection bias, rather than a clinically validated missingness process or all possible MNAR mechanisms.
3. Theoretical guarantee and neural FGW evaluation (W1)
We appreciate the reviewer's careful distinction between the theoretical formulation and the practical implementation. We agree that the excess-risk bound does not directly apply to our non-parametric, multi-epoch POT implementation, as discussed in Appendix B.6.
Appendix G.2 (Table 7) also evaluates a neural entropic FGW estimator based on a parametric completion map and a fixed memory bank. Under the sample-splitting and bounded-complexity assumptions of Theorem 2, this parametric formulation is theory-compatible.
Table 7 compares the neural estimator with POT. At 1% image-and-mask availability, POT achieves Dice scores of 0.800 versus 0.760 for neural FGW on QaTa-COV19 and 0.566 versus 0.365 on MosMedData+. These empirical results motivate our use of POT in the main experiments, but do not extend the theoretical guarantee to its non-parametric, multi-epoch implementation.
We hope the matched ablations, simulated MNAR results, and clarified theoretical scope address the central concerns and support a more favorable assessment.
Thank you for the response. The additional experiments help, but the theory still does not cover the main implementation, and evaluation relies on simulated missingness. I maintain my rating of 2.
We thank the reviewer for the follow-up and for recognizing the value of our additional experiments.
Regarding missingness, the original benchmarks do not provide naturally incomplete records with the corresponding ground truth needed for controlled evaluation. Simulating missingness allows us to preserve the original complete observations as ground truth and systematically evaluate different missingness rates and patterns. This is particularly important for assessing modality completion and ensuring reproducible, fair comparisons across methods. Beyond the original MCAR setting, our additional lesion-burden-dependent MNAR experiments further examine robustness under a different missingness mechanism. While these experiments do not replace validation on naturally incomplete clinical data, they provide controlled evidence of the framework's effectiveness under the evaluated settings.
Regarding theory, the main purpose of our analysis is to decompose the excess risk into distinct sources associated with empirical risk minimization, transport completion, recoverability, and function approximation. This helps us understand how different components of the framework contribute to the overall error, which terms can be controlled as the sample size increases, and which depend on completion quality or model capacity. While the current bound does not directly cover the deployed multi-epoch POT implementation, its scope and the corresponding theory–practice gap are now explicitly clarified in the revised manuscript.
We believe these controlled empirical findings and the theoretical insights within their stated scope provide meaningful contributions. We would appreciate the reviewer's reconsideration of the overall assessment of our work.
Response to Reviewer Cqa4 — Part 1/2
We thank the reviewer for the careful assessment of the theoretical assumptions and for the specific questions about memory-bank selection and missing-data mechanisms. We provide fixed-capacity memory-selection ablations, lesion-burden-dependent missingness experiments, and a clarification of the theorem's scope.
1. Uncertainty-based memory-bank selection (Q1, W3)
We agree that varying the memory-bank capacity does not independently assess the effect of uncertainty-based selection. To address this concern alongside the reviewer's question about non-MCAR missingness (Q2), we conduct a matched-capacity ablation using the same simulated lesion-burden-dependent MNAR setting examined in Section 2. This allows us to evaluate the contribution of memory-bank selection when paired-data availability depends on lesion burden.
We compare uncertainty-based selection with random selection and FIFO replacement, keeping the bank capacity and FGW completion settings fixed. For all methods, the bank capacity is set to 5% of the dataset size, with updates performed after every epoch. FIFO replaces the oldest 15% of bank entries, while Random uses random selection without uncertainty ranking. All methods use identical missingness splits and training protocols. We evaluate all five availability ratios on both QaTa-COV19 and Kvasir-SEG. The following tables report Dice/IoU under image-and-mask missingness.
QaTa-COV19
Kvasir-SEG
Uncertainty-based selection achieves the highest Dice and IoU in 8 of the 10 evaluated settings. In the remaining two settings, its Dice is only 0.001 below the best alternative. The gains are particularly pronounced at low availability. At 1% on QaTa-COV19, it achieves a Dice of 0.714, compared with 0.681 for Random and 0.663 for FIFO. On Kvasir-SEG, the corresponding scores are 0.535, 0.377, and 0.322. These controlled, fixed-capacity comparisons provide evidence that uncertainty-based memory updates can improve downstream segmentation under the simulated MNAR setting, without changing bank capacity or the FGW completion rule.
(Continued in Part 2/2.)