- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
RePath is a training-free method for whole-slide tumor segmentation using frozen histopathology VLMs. It selects tumor, normal, and non-tissue anchors from each slide, compares patches through Jensen–Shannon divergence over text-conditioned class distributions, and assigns tumor labels by contrasting category-specific affinities. Evaluation across four primary datasets and three backbones shows consistent improvements over vanilla zero-shot inference and competitive performance against methods using ten annotated slides. The appendix adds cross-center evaluation, smoothing baselines, and additional content.
Critical strengths
1.The method addresses a practical limitation of patch-wise VLM inference with a relatively simple procedure. Improvements over vanilla inference are consistent across all three backbones; for CONCH, average IoU increases from 49.9 to 63.6 across the four primary datasets. 2.The evaluation goes beyond comparisons with basic zero-shot methods. The appendix includes graph smoothing and label propagation, cosine-affinity ablations, additional segmentation datasets, and comparisons with weakly and fully supervised models. These experiments make the empirical contribution more convincing. 3.The prompt robustness analysis is useful. Repeating evaluation across ten prompt sets shows both higher average performance and lower variability, while the anchor-budget and sampling experiments support the use of a small anchor set.
Critical weaknesses
1.The clinical applicability is narrower than parts of the paper suggest. Appendix I reports only 8.6% specificity on tumor-negative Camelyon16 slides, and the main evaluation is restricted to tumor-bearing slides. The proposed screening-then-segmentation workflow is not evaluated. This does not invalidate the segmentation results, but statements about immediate deployment and robustness in clinical environments should be qualified. 2.The methodological advance needs more precise positioning. The paper explicitly builds on CDAM’s class-distribution observation, while the final DAI decision is equivalent to choosing tumor when its normalized affinity exceeds both competing affinities. The contribution therefore appears to lie primarily in the complete slide-specific inference procedure. In addition, the text does not clearly distinguish category-wise normalization from a shared normalization across all three maps; this distinction changes the classifier. Appendix G.8 also refers to the “same adjacency matrix” as RePath, although no adjacency graph appears in the proposed formulation. 3.Some evaluation details limit confidence in the finer claims. The paper states that hyperparameters are fixed across datasets but does not explain what data were used to select them initially. The significance tests quantify variation across prompts on a fixed test set, rather than uncertainty across patients or slides. There are also concrete reporting inconsistencies: Table A11 lists 35 small-tumor slides, whereas the accompanying text uses 34, and its detection percentages do not match the tabulated counts. The 0.95-second anchor-selection time in Table A9 also needs reconciliation with the 0.24-second inference time in Table A6.
Questions for authors
1.Are the affinity maps standardized separately for each category or jointly? Please provide the exact normalization formula and explain how empty normal or non-tissue anchor sets are handled. What adjacency matrix is being referenced in Appendix G.8? 2.What data informed the choice of the confidence threshold, pooling temperature, and backbone-specific softmax temperatures? Were these choices finalized before evaluating the reported test sets? 3.Can you reconcile the counts and detection rates in Table A11 and the timings in Tables A6 and A9? Please also provide paired slide-level confidence intervals for the main improvements, accounting for patient grouping where applicable
7 comments
[W2 / Q1] Methodological Contribution and Implementation Details.
W2. The methodological advance needs more precise positioning. The paper explicitly builds on CDAM’s class-distribution observation, while the final DAI decision is equivalent to choosing tumor when its normalized affinity exceeds both competing affinities. The contribution therefore appears to lie primarily in the complete slide-specific inference procedure. In addition, the text does not clearly distinguish category-wise normalization from a shared normalization across all three maps; this distinction changes the classifier. Appendix G.8 also refers to the “same adjacency matrix” as RePath, although no adjacency graph appears in the proposed formulation.
Q1. Are the affinity maps standardized separately for each category or jointly? Please provide the exact normalization formula and explain how empty normal or non-tissue anchor sets are handled. What adjacency matrix is being referenced in Appendix G.8?
Methodological contribution. RePath's primary contribution is its complete slide-specific inference procedure, which reformulates independent patch–text classification as intra-slide relational comparison. Specifically, RePath extends CDAM's class-distribution observation to WSI-level inference through automatically selected slide-specific anchors and integrates the resulting tumor, normal, and non-tissue relational affinities using DAI. While DAI's final binary decision is mathematically equivalent to a three-way affinity comparison, it operates on slide-specific relational affinities rather than direct patch–text similarities.
We have clarified this contribution in the Introduction (p. 2, lines 72–73) and the role and mathematical equivalence of DAI in Sec. 4.3 (pp. 6-7, lines 321–338).
Shared normalization and empty anchor handling. The three affinity maps are normalized jointly, not separately. For each WSI containing patches, a shared mean and standard deviation are computed over all raw affinity scores:
\qquad \sigma = \sqrt{\frac{1}{3N-1}\sum_{m\in\{T,N,J\}}\sum_{i=1}^{N}(R_m(x_i)-\mu)^2}.$$ The normalized affinities are $$\tilde{R}_m(x_i)=\operatorname{sigmoid}\left( \frac{R_m(x_i)-\mu}{\max(\sigma,0.05)+10^{-8}} \right), \quad m\in\{T,N,J\}.$$ Here, the standard deviation is lower-bounded by $0.05$ to prevent excessive amplification of small score variations, and $10^{-8}$ ensures numerical stability. If the normal or non-tissue anchor set is empty, its raw affinity map is set to zero before shared normalization. These zero-valued maps remain included when computing $\mu$ and $\sigma$. We have clarified the shared normalization in Sec. 4.2 (p. 6, lines 299–301) and provided the complete formula and empty-anchor handling in Appendix G.12 (p. 25, lines 1299–1322). **Clarification of the adjacency matrix.** RePath does not construct or use an adjacency matrix. The adjacency matrix mentioned in Appendix G.8 refers to the patch-neighborhood graph used by the graph-based smoothing and label propagation baselines, rather than RePath. We have revised Appendix G.8 (p. 23, lines 1201–1202) to clarify this ambiguity.[W3 / Q2 / Q3] Evaluation Details and Statistical Reliability.
W3. Some evaluation details limit confidence in the finer claims. The paper states that hyperparameters are fixed across datasets but does not explain what data were used to select them initially. The significance tests quantify variation across prompts on a fixed test set, rather than uncertainty across patients or slides. There are also concrete reporting inconsistencies: Table A11 lists 35 small-tumor slides, whereas the accompanying text uses 34, and its detection percentages do not match the tabulated counts. The 0.95-second anchor-selection time in Table A9 also needs reconciliation with the 0.24-second inference time in Table A6.
Q2. What data informed the choice of the confidence threshold, pooling temperature, and backbone-specific softmax temperatures? Were these choices finalized before evaluating the reported test sets?
Q3. Can you reconcile the counts and detection rates in Table A11 and the timings in Tables A6 and A9? Please also provide paired slide-level confidence intervals for the main improvements, accounting for patient grouping where applicable.
Correction of the Size-Stratified Analysis (Table A11 → A12 in the revised manuscript). One of the 35 small-tumor slides in the Camelyon16 test set was incorrectly processed in the previous analysis. We corrected this error and repeated the evaluation using a newly generated prompt set. The updated results include all 48 tumor-bearing slides, including 35 small-tumor slides. Both RePath and Vanilla detect tumors in 34/35 small-tumor slides (97.1%), while RePath improves IoU from 17.4% to 32.7%. We have updated the table and its accompanying discussion accordingly.
Correction of Anchor Selection Time (Table A9 → A10 in the revised manuscript). We identified that the previously reported 0.95 s/WSI for uniform anchor selection included additional operations beyond anchor selection, such as evaluation-related computations. After re-examining the timing records and conducting stage-specific measurements, the corrected uniform anchor selection time is approximately 0.0018 s/WSI, while the k-means selection time remains 8.24 s/WSI. This clarifies the discrepancy with the 0.24 s/WSI inference time reported in Table A6. We have corrected the table accordingly.
Hyperparameter selection. We aimed to use a common hyperparameter configuration across organs and cohorts, rather than optimizing parameters for individual datasets. The confidence threshold () was selected based on cross-dataset sensitivity analysis on the reported evaluation datasets (Table A3). The pooling temperature () was initially chosen as the midpoint of , with additional analysis showing at most 1.1 percentage points of variation in average IoU across four datasets (; Appendix G.20). Backbone-specific softmax temperatures () were chosen empirically based on class-distribution sharpness. These settings were selected using the reported evaluation datasets and applied consistently without dataset-specific tuning.
Paired slide-level confidence intervals. We additionally computed paired 95% bootstrap confidence intervals using 5,000 slide-level resamples. Results were obtained from an independent run with a different LLM-generated prompt set and therefore differ from those in Table 1. Patient identifiers were unavailable in the evaluation datasets; therefore, the analysis was conducted at the slide level.
Table R1. Paired slide-level bootstrap confidence intervals for RePath–Vanilla IoU improvements (percentage points). Results are from an independent run with a different LLM-generated prompt set and thus differ slightly from Table 1.
| Dataset | Mean ΔIoU | 95% CI |
|---|---|---|
| CM16 | +24.92 | [17.22, 32.78] |
| PAIP Prostate | +12.21 | [11.06, 13.42] |
| PAIP HCC | +16.96 | [15.23, 18.69] |
| PAIP Colon | +8.00 | [7.09, 8.93] |
All four confidence intervals exclude zero, supporting positive mean IoU improvements across the evaluated slides.
We have corrected the size-stratified analysis (Table A11 → A12 in the revised manuscript; p. 24, lines 1277–1297) and anchor selection timing (Table A9 → A10; pp. 23–24, lines 1234–1254), updated the corresponding results in the Discussion (p. 10, line 490), clarified the hyperparameter selection procedure (p. 7, lines 356–361; Appendix G.1), and added the pooling-temperature sensitivity analysis (Appendix G.20, p. 28, lines 1482–1496) and paired slide-level confidence intervals (Appendix G.21, pp. 28–29, lines 1499–1519).
We sincerely thank the reviewer for taking the time to carefully review our paper. We especially appreciate the reviewer's recognition that RePath addresses a practical limitation of patch-wise VLM inference through a relatively simple procedure, achieving consistent improvements across all three VLM backbones. We also appreciate the acknowledgment of our comprehensive evaluations, including additional baselines, ablation studies, and robustness analyses. We carefully address each concern below.
RePath is designed for tumor localization in tumor-bearing WSIs, rather than standalone tumor screening. As reported in Appendix I, its performance on tumor-negative slides indicates that RePath alone is insufficient for reliable slide-level screening. Accordingly, our main segmentation results should be interpreted as performance on tumor-bearing WSIs.
A potential approach is to separate slide-level tumor classification from tumor localization. Established methods, including MIL-based classifiers [R1–R2] and zero-shot approaches such as MI-Zero [R3], could provide initial screening, followed by RePath for tumor segmentation. This complete two-stage workflow has not been evaluated in our study.
We have clarified the intended scope in the Introduction (p. 1, lines 44–46) and the potential two-stage workflow and its limitations in Appendix I (p. 29, lines 1548–1551) and qualified statements regarding clinical feasibility and deployment in Appendix G.4 (p. 21, line 1121).
[R1] TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classification, NeurIPS, 2021.
[R2] Feature Re-embedding: Towards Foundation Model-Level Performance in Computational Pathology, CVPR, 2024.
[R3] Visual language pretrained multiple instance zero-shot transfer for histopathology images, CVPR, 2023.