- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a teacher–student framework for semi-supervised 3D medical image segmentation. Consensus Sharpening and Disagreement Reconciliation (CSDR) distinguishes uncertain agreement from informative disagreement using prediction agreement and entropy. It sharpens shared targets for uncertain agreement and progressively combines entropy minimization with confidence-weighted alignment for disagreement. Teacher-Perturbation Disagreement Probing (TPDP) perturbs teacher probabilities and uses the mean and variance of disagreement responses to weight supervision from the original teacher. The framework incorporates labeled-data pretraining and 3D CutMix. Experiments on LA, BraTS2019, and Pancreas-NIH cover two annotation budgets per dataset. The method reports the highest Dice among the listed methods in all six settings, with particularly notable improvements on Pancreas-NIH. Component ablations and sensitivity analyses provide additional evaluation.
Critical strengths
- Pancreas-NIH provides the strongest empirical result. At 10% labels, the reported Dice increases from the strongest listed comparator’s 78.53 to 82.92, and from the framework baseline’s 77.86 to 82.92. These gains suggest practical value for limited-label segmentation.
- The framework explicitly assigns different supervision strategies to different predictive states. CSDR and TPDP each improve the baseline across all three datasets, and their combination performs best in the module ablation. This supports the practical usefulness of integrating the two components.
Critical weaknesses
- TPDP uses perturbations to construct weights while retaining the original teacher as the supervision target. With zero perturbation, its score reduces to a function of the original teacher–student KL divergence. The current experiments do not clearly distinguish the benefit of probing from that of simply emphasizing larger discrepancies. The TP-only objective is also insufficiently defined. This matters because perturbation-response analysis is a central claimed contribution.
- The reported CML Dice/Jaccard pair of 77.26/56.21 requires clarification under standard binary metric definitions and matching averaging conventions. Several algorithm-defining settings are also omitted, making the comparison protocol difficult to reconstruct fully. In addition, the overlap gains do not consistently extend to boundary metrics, particularly on BraTS2019. These issues call for a targeted audit and a more precise account of the method’s benefits.
Questions for authors
- What exact objective is used for the TP-only configuration? When disagreement weighting is removed, how do the perturbations influence student optimization?
- Does TPDP outperform direct original-KL weighting when the effective loss scale is matched? If this comparison is already represented by the DW-only variant, please specify its exact formula and configuration.
- Can you verify the CML Dice/Jaccard values of 77.26/56.21 and explain their aggregation conventions? Under standard binary definitions and matching case weights, the reported mean Dice implies a mean Jaccard of at least approximately 62.95%.
5 comments
2.The reported CML Dice/Jaccard pair of 77.26/56.21 requires clarification under standard binary metric definitions and matching averaging conventions. Several algorithm-defining settings are also omitted, making the comparison protocol difficult to reconstruct fully. In addition, the overlap gains do not consistently extend to boundary metrics, particularly on BraTS2019. These issues call for a targeted audit and a more precise account of the method’s benefits.
Response: We sincerely thank you for the careful examination of our experimental results and for raising these important concerns regarding metric consistency, experimental reproducibility, and boundary performance. We agree that these aspects require careful verification and clearer presentation. We have therefore revised the experimental results and supplemented the implementation details and sensitivity analyses, as described below.
(1) Verification and correction of the CML results.
We thank you for identifying the inconsistency in the reported CML Dice/Jaccard pair (77.26/56.21). After tracing its source, we confirmed that these values, reported in Table 3 for the Pancreas-NIH dataset, were taken from the comparative results in Dycon (Assefa M, Naseer M, Ganapathi I, et al. Dycon: Dynamic uncertainty-aware consistency and contrastive learning for semi-supervised medical image segmentation. CVPR, 2025), rather than independently calculated using our evaluation pipeline. In the original submission, the quantitative results of the compared methods were primarily collected from their original publications or other relevant comparative studies, rather than obtained by rerunning all methods under a unified evaluation protocol. Consequently, we had not independently verified whether the reported CML Dice and Jaccard values were calculated using matching binary segmentation definitions and aggregation conventions. We acknowledge that this practice was not sufficiently rigorous and sincerely apologize for this oversight.
To improve the reliability and consistency of the quantitative comparisons, we reran all compared semi-supervised methods on the three datasets. In the original submission, their results were primarily collected from the original publications or relevant comparative studies. In the revised manuscript, all methods are evaluated using a unified pipeline, with Dice, Jaccard, ASD, and HD95 computed independently for each test case and reported as mean ± standard deviation. Accordingly, Tables 1-3 have been updated based on the reproduced results, and some quantitative values differ from those in the original submission. In particular, the CML results in Table 3 are now based on our reproduced experiments, with Dice/Jaccard values of 69.50 ± 12.49/53.40 ± 14.53 under the 10% labeled-data setting and 77.60 ± 7.91/63.60 ± 10.33 under the 20% setting.
(2) Completeness of implementation details and reproducibility.
We agree that the original manuscript did not sufficiently document several algorithm-defining hyperparameters, which could make the proposed framework difficult to reproduce. We have therefore expanded the Datasets and Experimental Setup section to explicitly specify the key parameter settings. These include the dynamic scheduling of the low- and high-entropy thresholds in CSDR, the temperature parameter and power-sharpening exponent in consensus construction, the perturbation magnitude, mean and variance weighting coefficients, and the number of perturbation samples in TPDP, as well as the loss weighting coefficients of the two proposed mechanisms.
Furthermore, we have substantially expanded the sensitivity analyses in the appendix to examine the effects of these key design choices. Specifically, we investigate the effects of temperature scaling and power-sharpening exponents within the +CS configuration, the sensitivity of CSDR to different entropy-threshold configurations, the influence of TPDP perturbation magnitude, the relative loss weights of CSDR and TPDP, and the balance between Consensus Sharpening and Disagreement Reconciliation. We also visualize the spatial distributions of the UA and ID masks under different threshold configurations to illustrate how threshold choices affect the regions selected by CSDR.
These additional descriptions and experiments provide a more complete account of the implementation settings and their influence on segmentation performance, thereby improving the reproducibility and transparency of the proposed framework.
(3) Discrepancy between overlap and boundary metrics.
We acknowledge your observation that improvements in region-overlap metrics do not consistently translate into better boundary-distance metrics, particularly on BraTS2019. A closer examination of the results confirms this observation. Our method achieves the highest Dice and Jaccard scores under both annotation settings. However, UnCo achieves lower ASD under both settings (1.96 vs. 3.07 at 10% and 1.68 vs. 2.45 at 20%). At the 10% setting, UnCo also achieves a lower HD95 (8.75 vs. 11.33), whereas our method obtains the best HD95 at the 20% setting (7.83).
This difference reflects the distinct optimization objectives of the proposed framework. CSDR and TPDP primarily improve semi-supervised learning by providing state-adaptive and perturbation-response-guided voxel-wise supervision, rather than explicitly optimizing surface-distance metrics. Consequently, improvements in regional overlap do not necessarily lead to uniformly improved boundary localization, particularly in anatomically complex structures with irregular boundaries. To address this point, we have refined the quantitative results discussion in the revised manuscript to explicitly distinguish improvements in regional overlap from those in boundary-distance metrics. In particular, we now explicitly acknowledge that the improvements in Dice and Jaccard on BraTS2019 are not consistently accompanied by improvements in ASD and HD95. We believe this provides a more balanced and accurate assessment of the proposed method across different evaluation criteria.
We sincerely appreciate your constructive comments, which have helped us identify inconsistencies in the original comparisons, improve the completeness of our experimental descriptions, and present the strengths and limitations of the proposed framework more accurately.
Critical Weaknesses:1.TPDP uses perturbations to construct weights while retaining the original teacher as the supervision target. With zero perturbation, its score reduces to a function of the original teacher–student KL divergence. The current experiments do not clearly distinguish the benefit of probing from that of simply emphasizing larger discrepancies. The TP-only objective is also insufficiently defined. This matters because perturbation-response analysis is a central claimed contribution.
Response: We thank the reviewer for this important comment. We agree that the original manuscript did not sufficiently clarify the TP-only objective or distinguish the contribution of perturbation-response analysis from direct KL-based disagreement weighting. We have therefore revised the ablation study in Section 4.3 to explicitly define these configurations and introduce additional uniform-scaling baselines.
Specifically, TP-only uses the K perturbed teacher predictions as direct supervisory targets for the student, following the same perturbation procedure and settings as full TPDP. Its loss averages the KL divergence between each perturbed teacher prediction and the student prediction, without disagreement-based weighting. By contrast, DW-only removes teacher perturbations and weights the KL divergence between the original teacher and student predictions according to its instantaneous magnitude. It uses the same λμ as full TPDP.
In particular, DW-only corresponds to the zero-perturbation limit of TPDP. When the perturbation magnitude \delta=0, all perturbed teacher predictions reduce to the original teacher prediction, yielding μR(v)=D(v) and σR2(v)=0, where D(v)=KL(pt(v)∥ps(v)). Consequently, the TPDP weighting score reduces to S(v)=λμD(v), which gives exactly the DW-only formulation. This comparison therefore isolates the additional contribution of perturbation-response information beyond instantaneous KL-based weighting.
We have also introduced two uniform-scaling baselines to examine whether the improvements arise merely from increasing the overall consistency-loss magnitude. Uniform-Mean preserves the average TPDP weighting factor while removing its voxel-wise variation, whereas Uniform-2× applies a simple fixed global scaling factor of two.
As shown in Table 6, both TP-only and DW-only improve upon the baseline. Full TPDP achieves the best results across all four metrics on all three datasets and outperforms both individual variants and the two uniform-scaling baselines. These results support the additional benefit of perturbation-response-guided voxel-wise weighting beyond direct KL-based disagreement weighting and global consistency-loss scaling.
The corresponding loss formulations, experimental configurations, and ablation results have been incorporated into the revised Section 4.3 and Table 6.