- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DPCNet, a medical image segmentation framework that calibrates frozen DINOv3 priors using foreground, uncertainty, and boundary cues derived from coarse segmentation predictions. The calibrated priors are incorporated into a Global Expert Collaboration Module (GECM), which combines frequency-based, long-range dependency, and DINO-based features for refined segmentation. Experiments on six medical segmentation datasets demonstrate competitive performance, supported by ablation studies and analyses of prior calibration.
Critical strengths
- The paper addresses a relevant problem concerning the transfer of generic DINO representations to medical image segmentation, where irrelevant background responses may interfere with target-specific feature learning.
- The experimental evaluation covers diverse medical imaging datasets and includes relatively comprehensive ablations. In particular, the controlled comparisons between raw and calibrated DINO priors provide evidence that the proposed calibration contributes to segmentation improvements beyond the two-stage architecture.
Critical weaknesses
- The methodological novelty is not sufficiently established. Using coarse segmentation predictions, uncertainty estimates, and boundary information to guide feature calibration is closely related to existing prediction-guided attention and coarse-to-fine refinement approaches. Moreover, GECM mainly integrates established frequency-domain processing, Mamba, and gated feature fusion mechanisms, making the overall methodological contribution less distinctive.
- The generalizability of the proposed calibration mechanism remains unclear. The method is evaluated exclusively with DINOv3 features, without investigating whether similar improvements can be achieved using other pretrained visual encoders. Although the ablation studies demonstrate the effectiveness of DPC within the proposed framework, they do not fully establish whether the benefits reflect a generalizable calibration strategy or are specific to DINOv3 representations.
Questions for authors
- What fundamentally distinguishes the proposed DPC mechanism from existing prediction-guided attention, uncertainty-aware feature refinement, and coarse-to-fine segmentation methods? Could the authors provide comparisons with simpler calibration alternatives under the same architecture?
- Why is DINOv3 selected as the only pretrained visual encoder? Can the authors evaluate DPC with other representative pretrained models, such as DINOv2, MAE, or CLIP, to demonstrate whether the calibration mechanism generalizes beyond DINOv3?
- Given the relatively modest improvement from calibrated DINO priors over raw priors in the controlled ablations, how do the authors justify the additional complexity of the proposed calibration and multi-branch global modeling framework?
2 comments
Response
My main concern remains the methodological novelty. The response clarifies DPC’s intended role, but its computational distinction from existing prediction-guided and uncertainty-aware refinement remains unclear. The novelty of GECM’s combination of established components is also insufficiently explained. I also remain concerned about generalizability. The DINOv2 gains are small, and both confidence intervals include zero. These results provide limited evidence that DPC offers consistent benefits beyond DINOv3, leaving uncertainty about how broadly the proposed calibration mechanism generalizes.
Target-Conditioned Prior Transfer, Encoder Generalization, and Computational Cost
Thank you for your questions. We added simpler alternatives, DINOv2 validation, bridge profiling, and a three-seed comparison.
1. Distinction from attention and refinement methods
Our contribution is target-conditioned selective transfer of natural-image DINO knowledge to medical segmentation, with controlled comparisons showing gains over simpler prior-processing alternatives. The coarse prediction identifies the current medical target, guides adjustment of the external prior, and the adjusted prior then supports fine segmentation. The distinction is target-dependent adaptation of transferred knowledge, beyond prediction-guided weighting of internal segmentation features.
Foreground, uncertainty, and boundary cues condition multiscale residual updates, with Q controlling their magnitude and DINO remaining frozen. The coarse-to-fine structure supplies target cues; GECM combines the prior with local, frequency, and long-range structure. These components support the adaptation and use of the external prior.
Supplementary Table 12 keeps the two-stage network, GECM, and training fixed. Kvasir-SEG Dice is 87.11 with raw priors, 87.44 with foreground-only conditioning, 87.43 with foreground times reliability, and 87.32 with reliability alone; full DPC reaches 87.83. Joint cues therefore improve over the tested simple alternatives.
New experiments replace prior processing with PraNet-style reverse attention or a generic adapter without coarse-prediction conditioning. All use 200 epochs, batch 4, seed 20261108, and the best validation checkpoint; splits are 880/120 for Kvasir-SEG and 517/130 for BUSI fold 0. Kvasir-SEG Dice/Jaccard (%) is 88.21/82.00 for raw priors, 88.04/82.12 for reverse attention, 87.81/81.70 for the adapter, and 88.47/82.26 for DPC. BUSI results are 77.68/70.40, 78.22/71.23, 77.89/70.61, and 79.51/72.55, respectively. DPC has the highest Dice and Jaccard on both datasets. Table 3 also shows foreground/far-background response ratio increasing from 2.02 to 2.84 and far-background share decreasing from 0.79 to 0.54, linking segmentation gains to more selective prior responses.
2. Choice of DINOv3 and encoder generalization
We selected DINOv3 because its spatial representations suit our multiscale prior interface, and the added DINOv2 experiments show that the calibration procedure also works with another pretrained encoder. DPC takes spatial features and target cues; changing the encoder requires adapting extraction layers, spatial sizes, and channel projections, while retaining target-conditioned residual calibration.
Each DINOv2 raw/calibrated comparison fixes the segmentation network, split, training budget, and evaluation. With batch 4 and seed 20261108, 60-epoch Dice improves from 87.35% to 88.32% on Kvasir-SEG and from 78.38% to 78.79% on BUSI fold 0. At 200 epochs, the corresponding changes are 88.50% to 88.62% and 77.86% to 78.35%. The 200-epoch Dice-change 95% CIs, from 20,000 image-paired bootstrap resamples, are [-0.91, 0.95] and [-0.84, 1.90] percentage points (pp). Both include zero: applicability is established, while gain size remains uncertain. MAE and CLIP need separate spatial-feature adaptation and have not been evaluated. We will state the validated encoder scope explicitly.
3. Accuracy gains relative to added complexity
The calibration bridge adds 3.15% measured forward time and about 0.021 GiB peak memory, while improving accuracy in controlled and repeated-seed comparisons. In an independent three-seed Kvasir-SEG experiment, DPC achieves 88.58 +/- 0.15% Dice versus 87.94 +/- 0.24% for raw priors, a mean gain of 0.64 pp (200 epochs, batch 4; mean +/- sample SD across seeds). This complements the single-seed results above.
Supplementary Table 9 isolates calibration while retaining the complete segmentation network and training settings. Dice rises from 87.11 to 87.83 on Kvasir-SEG and from 78.89 to 80.12 on BUSI. We report these original and new 200-epoch comparisons separately because training settings differ.
Paired bridge profiling uses RTX 5090, 512x512 input, batch 1, AMP FP16, 20 warm-ups, and 100 synchronized repetitions. Timing includes frozen DINOv3 and both segmentation stages, excluding I/O, CPU preprocessing, and postprocessing. Enabling DPC adds 1.676M active trainable parameters and 2.986G Conv2d MACs; this MAC count covers bridge convolutions, not the entire network. Peak memory rises from 0.432 to 0.453 GiB. The measured time increase is 3.15%.
GECM's additional value is assessed separately in Table 5: the full branch-and-gating combination improves Kvasir-SEG/BUSI Dice from A+D's 87.19/78.53 to 87.83/80.12. A+D retains CNN anchoring and the calibrated prior. Removing FFT and Mamba reduces branch-experiment latency from 29.27 to 25.34 ms/image (13.41%). These results support calibration and complementary image modeling. We will report their profiling protocols separately.