- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Relative Intensity Relations (RIR), a framework that leverages within-volume intensity ranks and local intensity relationships to improve single-source generalization for brain tumor segmentation under unseen pathology-associated shifts. The method integrates relational features with conventional image representations and incorporates source-only model selection. While the problem is relevant, the current evaluation is limited in scope and does not sufficiently substantiate the broader generalization claims.
Critical strengths
The study addresses single-source domain generalization under incomplete pathology coverage, a meaningful challenge in medical image segmentation. Modeling relative intensity relationships provides a reasonable complement to absolute intensity features and may improve robustness to distributional variation.
Critical weaknesses
-
The title, “RIR: Relative Intensity Relations for Single-Source Generalization under Unseen Pathology Shifts,” suggests a general methodology for single-source generalization under pathology shifts. However, the experiments are limited to brain tumor segmentation on FLAIR MRI, with a single glioma source cohort and two external cohorts from BraTS-Africa. In particular, the difference between the source glioma cohort and the Other Neoplasms cohort does not isolate pathology shift from other sources of distributional variation, such as differences in tumor burden, morphology, and spatial distribution. Moreover, both external cohorts remain within the relatively narrow setting of brain tumor segmentation. The current evidence therefore does not establish generalization across pathology shifts in a broader sense, nor does it demonstrate applicability to substantially different medical imaging tasks or clinical settings. The title and claims should be narrowed to reflect the actual experimental scope.
-
The evaluation relies too heavily on Dice and lacks a sufficiently comprehensive assessment of segmentation quality. The experimental analysis primarily emphasizes Dice similarity coefficient, with sensitivity reported as an additional metric. This is insufficient to fully characterize segmentation performance, particularly when the method is intended to improve robustness under substantial distribution shifts. Boundary-based metrics, such as HD95 and average surface distance, are important for assessing contour accuracy and the spatial extent of segmentation errors. Furthermore, the manuscript does not establish whether the observed improvements translate into benefits for clinically relevant downstream tasks, such as tumor burden quantification, lesion characterization, or treatment planning. Without more comprehensive geometric evaluation and downstream validation, the practical significance of the reported improvements remains unclear.
-
The comparison with established segmentation methods and domain generalization approaches is insufficient. The main quantitative comparison includes BASE, RandConv, and DSU, which provides a limited view of the proposed method's relative performance. The study lacks comparisons with strong segmentation baselines, such as nnU-Net, and a broader range of competitive domain generalization methods under matched experimental conditions. These comparisons are necessary to determine whether RIR offers a meaningful advantage over well-established segmentation pipelines and existing generalization strategies, rather than simply outperforming a small subset of baselines. The broader comparison presented in the manuscript does not fully resolve this concern unless the methods are evaluated under consistent data splits, supervision budgets, and training protocols.
-
The experimental setting does not sufficiently support the emphasis on pathology generalization. Although the manuscript frames unseen pathology as a central challenge, the evaluation is confined to a specific MRI segmentation task and a limited set of related cohorts. The external Other Neoplasms cohort introduces variation beyond tumor category, making it difficult to attribute the observed performance differences specifically to pathology shifts. In addition, the manuscript does not adequately investigate whether the proposed relative-intensity representation remains useful across substantially different acquisition conditions, imaging modalities, anatomical regions, or disease categories. Consequently, the current experiments support, at most, the utility of RIR in a particular external brain tumor segmentation setting, rather than the broader pathology-generalization capability suggested by the title.
-
The qualitative visualizations require substantial improvement in both presentation and technical clarity. The figures appear insufficiently polished for a conference submission of this level. More importantly, Figure 4 appears to present the task as a simplified binary tumor-versus-background segmentation problem, without adequately clarifying how the evaluation relates to the different tumor subregions or annotation categories in the BraTS setting. As currently presented, the figure makes it difficult to assess the method's behavior on different lesion components and to verify that the visual comparisons are fully representative of the underlying segmentation task.
Questions for authors
Refer to weakness