- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a framework for Gut segmentation based in a centerline parameterisation. The authors propose to learn a depth coordinate (measured as distance from the centerline) as a diffeomorphism-invariant ordered semantic segmentations where W is separated in fixed segments b1<b2<b3... and the network predicts the depth d.
Critical strengths
None
Critical weaknesses
The experimental section is a bit of a mess. It is unclear what methods are implemented, what is compared and under which conditions. Table 1 compares a few models but includes for eaxmple lines like "Consistency Loss" or "Uncertainty Loss" which are not introduced in the paper (indeed "Uncertainty Loss" is only used in Table 1). It is unclear why some models are reported with precision/recall, and some without. human-in-the-loop training is just reported as helpful but it is unclear which model, how many rounds, and whether all models shown have been trained with human-in-the-loop, equally.
I hoped the ablation study would resolve some of the issues, but it turns out that it is not a systematic check of removing components of a model to see their effects, but instead it seems to be an unsystematic comparison of different methods. I do not know why the numbers in Table 4 differ so significantly from Table 1, and if training settings are just short runs, then it is unclear to me how training settings in which all models perform that poorly should guide model-selection.
Beyond this, i have concerns about the methodology and novelty. U,V,W maps for gut coordinate systems by themselves are not novel. the authors propose a new way to encode the depth coordinate but they never disclose how the depth labels b_i are derived and computed and never discuss the results.
While RMSE on d is reported numerically, it is quite large and the authors report as the numbers of "their" model (DICE, precision etc) the "Cross-entropy + RMSE" model which performs slightly better in DICE score but is significantly worse in RMSE (0.22 vs 0.08 in the comparison model). This choice of final model is surprising, since the W-encoding is the core novelty and the authors decided to not even discuss the differences in RMSE as if the quality of the encoded depth variable does not matter at all. Note that RMSE ~0.29 is the baseline of predicting d=0.5, so the chosen model is only a little better than predicting the average.
Eq (5) is completely nebulous because it uses b_{s(x)} where s(x) is a centerline location in 3D space by eq (2), but b_i is indixed with an ordinal. Later on a new variable s is introduced which is the classification label, so i assume that this s is meant.
Questions for authors
Can you discuss the reported RMSE values and their importance to your work?
Thank you to all reviewers for their thoughtful feedback and for helping improve the quality of our paper. In response to the reviewers, we have incorporated extensive additional experiments and made considerable revisions during the rebuttal period. We believe the manuscript has become substantially stronger as a result. We also want to assure the committee that we strictly followed all official ICLR guidelines throughout the rebuttal process.
Response to Reviewer (Critical Weakness): We thank the reviewer and have reorganized the experimental section to make the distinct components of this study (Tissue Segmentation, Statistical Analysis, and Registration/ Landmark Alignment) more clear and make all comparisons and training conditions explicit. In the revised manuscript, we have strived to use consistent terms to define our analyses and thank the reviewer for pointing out our inconsistencies. The revised tables 4 and 5 now separate architecture comparisons from controlled ablations, and all rows are evaluated using the same data split, preprocessing, checkpoint selection, and metric implementation. We also revised the previous HITL description.
Updated table 4 shows loss formulation and uncertainty weighting in the proposed 2.5D framework, and added table 5 depicts ablation of spatial dimensionality, auxiliary depth supervision, and HITL-based data refinement. We also resolved the previous discrepancy between Tables 1 and 2; identical models now report identical results across tables. Short-run experiments are no longer used for final model selection. We agree that the use of a (U,V,W) coordinate system itself is not novel. We have revised the manuscript to make this distinction explicit. In GutCCF, U and V are derived from the known imaging/acquisition geometry, while the methodological contribution is the anatomically supervised prediction of the continuous transmural coordinate W, followed by cross-specimen registration to construct a standardized mouse ileum CCF. We also added the previously missing description of the depth targets b_i. The targets are generated directly from expert anatomical masks by assigning the ordered serosa-to-lumen classes the normalized values b_i=(0,0.1,0.3,0.5,0.7,0.9,1.0). The depth head predicts a global normalized transmural position, W ∈ [0,1]. This auxiliary objective encourages the network to learn the ordered anatomical organization of the intestinal wall in addition to discrete semantic labels. The revised manuscript now also reports quantitative results for this coordinate prediction. The presented results provide direct evidence that the learned depth representation captures anatomically meaningful transmural position and supports registration to the population-derived CCF.We also clarify that the CE+RMSE objective does not mathematically guarantee monotonicity, continuity, or a non-folding coordinate map, instead anatomical ordering and boundary consistency are evaluated empirically.
During revision, we re-evaluated the held-out test set using a consistent evaluation pipeline and corrected Table 1. The previously reported Dice value of 0.8248 corresponded to the Macro-F1 score; the corrected test Dice is 0.6241. We also corrected the depth evaluation, with the proposed model achieving a Test Depth RMSE of 0.0806, substantially lower than the previously reported value and the ~0.29 constant-depth baseline noted by the reviewer. The revised table now clearly distinguishes Dice, Precision, Recall, Macro-F1, and Test Depth RMSE. We have updated table 2 (updated table 4) and added table 5 in the manuscript.
The reviewer is correct: Eq. (5) is intended to use the predicted tissue-class index, not the centerline arc-length variable used in Eq. (2). Reusing s(x) for these two quantities makes the current formulation unnecessarily ambiguous. We have corrected the notation throughout the manuscript by reserving s(x) exclusively for centerline arc length. Equation (5) has been rewritten. We have also revised the surrounding text before Eq. (5), and use this notation consistently in the model description and coordinate-construction sections. This is a notation error in the original manuscript rather than a change to the underlying formulation, and we appreciate the reviewer for identifying it.
Response to Reviewer (Questions For Authors): We thank the reviewer for this question. RMSE is a key metric in our work because it directly measures the accuracy of the predicted transmural coordinate (W), normalized from serosa (W=0) to the luminal/villus surface (W=1), while penalizing larger depth errors more strongly [updated manuscript, table 1, Line 433]. The selected CE+RMSE model achieves a validation depth RMSE of 0.0806, corresponding to approximately 8% of the normalized wall depth and substantially outperforming the (\sim0.29) constant-depth baseline. On 94 held-out test images, the class-derived depth analysis yields a mean per-image RMSE of 0.0809 and MAE of 0.0467. These results indicate that the predicted (W)-coordinate provides meaningful transmural localization and is therefore directly relevant to the accuracy of the proposed ileum CCF.