- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Tubularity-Aware Pretraining (TAP) for 3D vessel segmentation. It combines mixed cubic and curvilinear reconstruction (HIDE), intensity-matched implant localization (IMPLANT), and wavelet detail prediction (SHARPEN) to learn representations from unlabeled CT images before supervised fine-tuning.
Critical strengths
- The motivation is clear and practically relevant. The sparse, elongated morphology of vessels and the difficulty of preserving small branches provide reasonable grounds for designing structure-aware pretraining tasks. The framework also requires no additional modules during downstream inference.
- The experimental evaluation is reasonably comprehensive. The component ablations support the complementary value of reconstruction, localization, and detail prediction. The controlled comparison in Table 8 is particularly useful because it aligns the pretraining corpus, backbone, and training protocol across competing self-supervised methods.
Critical weaknesses
- The methodological novelty needs clearer positioning. VasoMIM (Huang et al., 2026), already discussed in the paper, incorporates vascular anatomy into masked image modeling. Wavelet reconstruction targets have also been explored in WaMIM (Xiang et al., 2025). These approaches differ from TAP in their inputs, objectives, and applications, but the paper should explain more precisely what advances beyond adapting and combining these established ideas.
- The evidence for vessel-specific representation learning remains partly indirect. Curvilinear masks are generated independently of actual vessel locations, while wavelet detail targets include nonvascular boundaries and noise. The downstream improvements support the usefulness of these tasks, but do not fully establish that they specifically improve vascular connectivity rather than general local reconstruction and discrimination. The component effects also vary across datasets, and adding an individual component does not consistently improve every setting.
- The evidence for cross-dataset transfer is limited. All datasets in Tables 1 and 8 contribute training images to TAP pretraining, so these experiments primarily demonstrate the benefit of pretraining within the evaluated datasets. ASOCA is the only dataset excluded from pretraining and is evaluated after supervised fine-tuning. This supports transfer to one additional dataset, but is insufficient to establish broad transferability across vascular anatomies and acquisition settings. A leave-one-dataset-out evaluation using the existing datasets would substantially strengthen this claim.
Questions for authors
- Can the authors compare TAP with adaptations of VasoMIM’s anatomy-guided masking and WaMIM’s wavelet targets, using the same 3D backbone, pretraining data, and training budget, to isolate TAP’s contribution?
- Can the authors evaluate cubic masking, mixed masking, and full TAP using branch detection rate and centerline discontinuity counts, stratified by vessel diameter, to test whether the gains reflect improved vascular connectivity?
- Can the authors assess cross-dataset transfer through leave-one-dataset-out pretraining on the existing datasets, or evaluation on additional vessel datasets excluded from pretraining, using identical fine-tuning label budgets for TAP and the strongest SSL baseline?
5 comments
Response to Reviewer DEjg (2/2)
W3 / Q3. Transfer beyond the pretraining corpus
Leave-one-dataset-out. We pretrained TAP without Parse2022, the only pulmonary dataset in the corpus, and fine-tuned it on Parse2022 under the same protocol. The baselines are the Table 8 checkpoints, pretrained with Parse2022 included. Each entry is DSC/clDice.
| Pretraining (fine-tuned on Parse2022) | 100% labels | 10% labels |
|---|---|---|
| DAE, with Parse2022 (best Table 8 baseline on Parse2022) | 84.17/73.32 | – |
| SwinMM, with Parse2022 | 83.76/71.49 | – |
| TAP, with Parse2022 | 87.39/81.63 | 84.46/74.89 |
| TAP, without Parse2022 | 85.17/75.46 | 83.90/73.64 |
Unlabeled images of the target dataset do help, and the usual self-supervised setting has them. Even without them, TAP exceeds every Table 8 baseline, and with 10% of the labels it stays within 0.56/1.25 of TAP pretrained with Parse2022.
Datasets excluded from pretraining. We also evaluated two more datasets excluded from pretraining, with identical label budgets for TAP and SwinMM, the strongest self-supervised baseline in Table 8. Both start from their Table 8 checkpoints, which share corpus, backbone and schedule. COSTA-IXI-HH, the Hammersmith Hospital subset of COSTA, has 60 brain TOF-MRA images of healthy volunteers (48 for training, 12 for testing). AirRC-GE, the GE-scanner subset of AirRC, has 142 chest CT images with pulmonary artery annotations (114 for training, 28 for testing). Each entry is DSC/clDice.
| Unseen dataset | Labels | Scratch | SwinMM | TAP |
|---|---|---|---|---|
| ASOCA (coronary CTA) | 100% | 80.71/79.09 | 84.75/83.04 | 86.13/84.54 |
| 10% | 69.34/64.19 | 71.56/70.39 | 74.40/72.60 | |
| COSTA-IXI-HH (brain TOF-MRA) | 100% | 93.09/92.58 | 94.02/93.14 | 94.53/94.23 |
| 10% | 88.63/85.60 | 89.27/87.53 | 90.11/88.63 | |
| AirRC-GE (pulmonary arteries, CT) | 100% | 87.72/83.03 | 90.00/87.40 | 91.58/90.08 |
| 10% | 84.54/79.17 | 86.30/83.08 | 88.41/85.49 |
TAP leads SwinMM in all six comparisons, by 1.16/1.76 DSC/clDice on average with full labels and by 1.93/1.91 with 10% labels, and on every dataset the DSC margin grows as labels decrease. On AirRC-GE, TAP fine-tuned with 10% of the labels (88.41/85.49) exceeds training from scratch with all labels (87.72/83.03). Both experiments are now in App. D.2 of the revision.
Thank you again for these suggestions, which have strengthened the paper.
Thank you for conducting all three experiments. These are substantial experiments to complete within a week, and the results are impressive and provide strong support for your claims. I think TAP is well designed for this task and makes an important contribution to vessel segmentation. I would therefore raise my recommendation from Weak Accept to Accept at the final stage.
One point I hope you will address in the revision concerns the connectivity evaluation raised by Reviewer jPY9 in W2 / Q3. The additional evaluation and the improvement in connected-branch recall are also impressive. However, this criterion may count some incomplete or incorrect connections as successful. For example, i) a branch could count as detected even if its actual junction is broken but a wrong path connects it to the trunk, or ii) if only half of its centerline is recovered. Other types of errors may also go undetected by this criterion. I hope the revision will explain whether these cases were checked and show examples where the model succeeds and fails to recover the connections. Sharing these cases openly would help readers understand what the model does well, where it still fails, and how it could be improved.
Response to Reviewer DEjg (1/2)
Thank you for the positive assessment and the concrete suggestions. We ran all three experiments you proposed and report them below.
W1 / Q1. What TAP adds beyond VasoMIM and WaMIM
VasoMIM and WaMIM keep masked reconstruction as the task and change where or what the network reconstructs. VasoMIM masks more often the patches that a vesselness filter marks as vessels, and WaMIM reconstructs multi-level wavelet coefficients instead of pixels.
TAP differs in three designs. Hide gives part of its masks the shape of vessels instead of placing masks where a vesselness filter finds vessels, so it needs no vessel detector. Implant adds a localization task, which neither method has. Sharpen removes fine Haar detail from the input and asks the network to restore it, instead of reconstructing the wavelet coefficients of the image.
Controlled comparison. We replaced Hide's masks with VasoMIM-style masking and Sharpen with WaMIM-style targets, one at a time, keeping the 3D backbone, pretraining data, training budget and other components unchanged. Both methods are 2D, so we extended them to 3D. VasoMIM-style masking places cubic masks preferentially where a 3D Frangi vesselness map marks likely vessels, at TAP's masking ratio. WaMIM-style targets replace Sharpen with a 3D version of WaMIM's multi-level wavelet target, with the same total loss weight.
TAP's tubular masks and Sharpen thus outperform the corresponding VasoMIM and WaMIM designs by 2.66/3.24 and 0.61/1.85 DSC/clDice, respectively.
W2 / Q2. Do the gains reflect vascular connectivity?
As you suggested, we evaluated cubic masking, mixed masking and TAP by branch detection and centerline gaps, stratified by vessel diameter. We split each ground-truth skeleton into branches at bifurcations. A branch counts as detected only if at least 50% of its centerline is covered by the predicted component that also covers the trunk of its tree. An internal gap is an uncovered centerline segment between two covered ends. Caliber is the mean diameter along a branch. Values are averaged over cases and then over the four test sets.
In every diameter group, TAP has the highest connected-branch recall and the fewest gaps. Over all calibers, its connected-branch recall is 63.72, against 57.03 for cubic masking and 59.38 for SwinMM, and its Betti-0/1 errors are 83.40/12.04, against 170.41/19.32 and 122.66/14.47. The gains therefore reflect better vascular connectivity, not only better local reconstruction, including in small vessels.
The detail target also contains non-vascular boundaries and noise. Like the tubular masks, it carries the vessel prior through scale rather than location. Per voxel, vessels carry 2.81 times the background detail energy in CTA and 24.27 times in TOF-MRA, so the target emphasizes vessels over the background. In the table, adding Implant and Sharpen to mixed masking reduces gaps in every diameter group and raises connected-branch recall below 2.5 mm from 42.19 to 47.40.
Component effects do vary across datasets (Table 3), and we think this may relate to the vascular anatomy of each dataset. Tubular masking helps most on ImageCAS, possibly because its coronary arteries are a few long, thin vessels, close to the shape of TAP's masks. On Parse2022 and SEG.A, it changes DSC and clDice by less than 0.7, whereas adding Implant or Sharpen to it raises DSC by 3.5–6.8 and clDice by 6.0–8.2. In Parse2022, small pulmonary branches run among veins and airways of similar caliber, and in SEG.A small branches leave the much larger aorta, so telling a structure apart from its surroundings (Implant) and recovering fine detail (Sharpen) may matter more there than completing a path. TAP therefore uses the three tasks together, and the full model has the best DSC, clDice, Jaccard index and NSD on all four datasets (Tables 3 and 7).