- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes GCLDS, a latent diffusion framework for medical image segmentation. The method combines three changes: channel compression in the U-Net bottleneck, a channel-spatial disentangled gated skip connection conditioned on the diffusion timestep and encoder-decoder features, and a latent contour alignment loss based on Sobel gradients. Experiments on BTCV, ISIC2017, ISIC2018, and REFUGE2 report improvements in region-overlap and boundary metrics over the compared methods. The paper also reports reduced trainable parameters, training memory, and inference time relative to several diffusion-based baselines. The current framework is limited to binary segmentation.
Critical strengths
-
The paper targets three practical limitations of latent diffusion segmentation: backbone cost, static skip-feature fusion, and weak boundary supervision. The proposed components are simple to implement and are evaluated through individual and combined ablations.
-
The evaluation includes CT, dermoscopic, and retinal image datasets, with both region-based metrics and boundary-sensitive metrics. The reported results show improvements over the compared diffusion baselines, and the efficiency comparison suggests that the compressed bottleneck can reduce model cost without an obvious loss of segmentation accuracy.
Critical weaknesses
-
The main technical components are relatively incremental. Bottleneck compression, gated skip connections, and gradient-based contour losses are established design ideas, and the paper combines them within a latent diffusion segmentation pipeline. The ablations support the usefulness of the components, but do not fully establish a methodological advance beyond this combination. The authors should better distinguish the proposed design from existing adaptive skip connections and boundary-aware segmentation objectives.
-
The contour loss is computed on VAE-encoded mask latents rather than on the decoded segmentation boundaries. The paper shows qualitative latent-gradient maps, but it remains unclear how closely these gradients correspond to clinically relevant contours in pixel space. In addition, all tasks are formulated as binary segmentation, including BTCV, where the 13 foreground organs are merged into one class. This limits the evidence for the method’s usefulness in multi-class medical segmentation, a setting that is important for many clinical applications. The authors should clarify the relationship between latent contour alignment and actual boundary accuracy, and narrow the scope of their claims or provide multi-class validation.
Questions for authors
-
How strongly do the Sobel gradients of the VAE latent masks correspond to boundaries in the decoded pixel-space masks? Can the authors quantify this relationship or compare the proposed loss with a contour loss applied in pixel space?
-
Since the BTCV organs are merged into a single foreground class and all benchmarks are treated as binary segmentation, what evidence supports extending the method to multi-class segmentation? Can the authors clarify the intended scope of the method?
-
What is the specific methodological novelty of the proposed channel-spatial gating and contour alignment loss compared with existing adaptive skip-connection and boundary-aware segmentation methods?
Novelty and Differences from Existing Methods. We thank the reviewer for the constructive and insightful comments. We agree that the individual components of our method are related to established techniques. Our contribution lies in adapting and integrating these components for pre-trained latent diffusion medical image segmentation. Specifically, unlike existing adaptive skip-connection methods such as Attention U-Net, CBAM, and FreeU, our channel-spatial gating explicitly separates the sources of channel and spatial modulation. The channel gate is conditioned only on the diffusion timestep embedding, while the spatial gate is derived from paired encoder-decoder features. This design provides separate control over channel responses and spatial feature selection within the latent diffusion denoising framework. For contour alignment, unlike conventional boundary losses that operate on full-resolution masks, our loss applies gradient consistency directly to VAE-encoded mask latents. This provides a memory-efficient alternative to pixel-space contour supervision. We will expanded the related-work section to clarify these differences.
Effectiveness and Computational Efficiency of Latent-Space Contour Supervision. To investigate the effectiveness of latent-space contour supervision, we conducted controlled experiments comparing SDSeg, GCLDS with pixel-space contour loss, and GCLDS with latent-space contour loss. All experiments were performed using three independent random seeds under identical network architectures and training settings. As shown in Table R1, latent-space contour supervision achieves slightly better region-overlap performance and comparable or better boundary-distance metrics (HD95 and ASD) than pixel-space contour supervision across all three datasets. These results suggest that latent gradients provide useful structural information for improving segmentation boundaries, although they should not be interpreted as direct pixel-level boundary representations.
We also compared the computational costs of the two approaches. Although the VAE decoder weights are frozen, gradients must still propagate through the decoder when computing the pixel-space contour loss. This requires retaining full-resolution decoder activations during backpropagation, resulting in approximately 6,918 MB of additional training GPU memory consumption compared with latent-space contour supervision. Therefore, the proposed latent-space contour loss provides a more memory-efficient alternative while maintaining competitive segmentation and boundary performance.
Applicability to Multi-Class Segmentation We acknowledge that all experiments in the current study are formulated as binary segmentation, including BTCV, where the 13 organ labels are merged into a single foreground class. Therefore, the current experiments do not provide direct empirical evidence of the method's effectiveness in multi-class segmentation. Our framework is currently designed and validated for binary medical image segmentation, and extending the method to native multi-class segmentation requires addressing the fixed-channel output representation of the pre-trained mask VAE. Although sequential per-class inference is possible, it increases inference cost with the number of classes, while adapting the VAE to multi-channel mask representations requires additional training and computational resources. We have clarified these limitations and identified multi-class latent diffusion segmentation as an important direction for future work.
Table R1. Quantitative comparison of SDSeg, GCLDS with pixel-space contour loss, and GCLDS with latent-space contour loss on BTCV, ISIC2017, and ISIC2018. All results are averaged over three independent runs and reported as mean ± standard deviation. Pixel-space contour supervision requires an additional ~6,918 MB of training GPU memory compared with latent-space contour supervision.