- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes an end-to-end framework for unsupervised CT–MR registration using a histogram-conditioned contrast transformation network. The transformed CT, original CT, and target MR are processed by a shared encoder, with dynamic mixing of the two CT feature streams before deformation estimation. The transformation and registration networks are jointly optimized using image similarity, histogram matching, content preservation, and deformation smoothness objectives. Experiments on two abdominal CT–MR settings demonstrate improved registration performance across seven backbone architectures.
Critical strengths
-
Consistent improvements across multiple registration architectures. Adding TransNet improves DSC for all seven evaluated backbones on both datasets. This is a strong empirical evidence in the paper and supports the module’s practical utility beyond a single selected architecture.
-
A well-motivated integration of contrast transformation and registration. Using the target MR histogram rather than the spatial MR image is a reasonable design choice for limiting the direct introduction of target-specific spatial information.
-
Evaluation considers both alignment accuracy and deformation regularity. The main RDP-based configuration improves DSC, HD95, and ASSD on both datasets while reporting lower non-positive Jacobian percentages than the RDP baseline.
Critical weaknesses
1. The advantage of histogram-conditioned transformation over image synthesis strategies is insufficiently established.
The paper motivates its method by contrasting it with conventional image synthesis, but does not provide a controlled comparison between histogram-conditioned TransNet and a conventional CT-to-MR synthesis module within the same registration framework. INNReg is evaluated, but comparing two complete pipelines does not isolate the contribution of the transformation strategy. Table 3 shows that adding histogram conditioning improves DSC from 0.649 to 0.658; however, this only establishes an incremental benefit within the chosen architecture. A direct histogram-matching baseline is also absent. Consequently, it remains unclear whether the proposed learned transformation offers a meaningful advantage over either conventional synthesis or a much simpler intensity-mapping operation。
2. The intended role of TransCT is not sufficiently validated through independent quantitative evaluation.
Figures 3–4 provide checkerboard visualizations and a sampled gradient-profile comparison, so the paper does offer some evaluation of TransCT itself. However, these examples do not establish, across the test set, that TransCT simultaneously preserves source anatomy and reduces the appearance discrepancy with the target MR relative to the original CT. End-to-end training is not inherently problematic, but improved downstream registration alone does not isolate the claimed contrast-normalization mechanism from other changes introduced by the auxiliary branch, feature mixing, and additional losses. The reported quantitative metrics primarily assess final registration and deformation regularity, rather than the intermediate transformation. Independent evaluation is therefore needed to support the claim that the method improves registration specifically by reducing the modality gap without introducing anatomical distortions.
3. The state-of-the-art claims are not adequately supported by the comparison scope.
The experiments do not include comparisons with recent methods such as OTMorph and TransReg, which share conceptual similarities with the proposed approach. As a result, the proposed method’s performance relative to these alternatives remains unclear. TransReg is already cited in the manuscript but is not experimentally evaluated. Furthermore, the main RDP+TransNet configuration achieves 0.658 DSC on Learn2Reg, whereas the unmodified ModeT and PCNet baselines in Table 2 achieve 0.688 and 0.692, respectively. Although ModeT+TransNet reaches 0.704, the manuscript should distinguish the incremental benefit of the module from the overall ranking of a particular instantiated model. These issues do not invalidate the reported within-backbone improvements, but they weaken the broader claim of superiority over existing approaches.
Questions for authors
-
How does histogram-conditioned TransNet compare with conventional CT-to-MR synthesis under a matched registration setup? This would help determine whether the proposed transformation strategy itself offers an advantage, rather than differences between complete registration pipelines.
-
How much improvement requires a learned transformation rather than direct histogram matching? Could you replace TransNet with direct CT-to-target-MR histogram matching and retrain the registration network? Please also clarify whether the “w/o MR-hist” variant removes only histogram conditioning or additionally removes the histogram-based EMD loss.
-
Can you quantitatively validate TransCT independently of the final registration output? In particular, does TransCT exhibit a smaller appearance discrepancy with the target MR than the original CT, while retaining the source CT’s anatomical locations and boundaries?
-
Can you establish the method’s relative performance against OTMorph and TransReg and reconcile the SOTA claims across Tables 1 and 2?
-
How well does TransCT resolve tissue-specific contrast differences, particularly in bone regions? In the examples shown in Figure 3, cortical bone appears to remain relatively bright in TransCT, resembling the original CT rather than the low-signal appearance in the MR images. This suggests that important tissue-specific contrast discrepancies may remain unresolved despite global histogram alignment.
6 comments
Response to Reviewer 2fP3 (2)
W2 and Q3. What the pre-registration evaluation establishes.
We agree that final registration accuracy and deformation regularity cannot, by themselves, validate the intermediate transformation. We therefore measured TransCT before applying the predicted deformation on the Learn2Reg test set:
| Image before registration | Whole‑volume Wasserstein‑1 to MR ↓ | Detected‑edge ASSD to CT (mm) ↓ | Detected‑edge HD95 to CT (mm) ↓ |
|---|---|---|---|
| Original CT | 0.1824 | 0.00 | 0.00 |
| Direct histogram matching | 0.0091 | 10.32 | 42.66 |
| CycleGAN | 0.0465 | 28.53 | 79.16 |
| TransCT | 0.0316 | 1.24 | 5.34 |
The reduction from 0.1824 to 0.0316 shows a smaller discrepancy in the global intensity distribution relative to the original CT. Notably, direct histogram matching achieves a smaller Wasserstein-1 distance than TransNet but substantially lower downstream DSC, 0.600 versus 0.658. Thus, global histogram agreement alone does not explain the registration results.
We also qualify the structural interpretation. Edge-set distances depend on contrast and edge-extraction thresholds: pointwise histogram matching can change those sets without moving voxel coordinates. The table therefore reports detected-edge agreement under the implemented measurement, not anatomical displacement. Furthermore, Wasserstein-1 is related to our EMD training objective, so this is an evaluation outside the final registration output, not an independent validation of every proposed mechanism.
The histogram input omits the spatial arrangement of the target MR, the MI term encourages dependence on the source CT, and feature mixing retains an original-image pathway. These are design choices intended to reduce transformation-induced errors; none guarantees anatomical invariance. We will remove the categorical “without changing anatomy” claim and expand the qualitative examples using consistent sampling across all held-out cases. The present evidence supports useful contrast transformation with favorable observed edge agreement, while anatomical preservation remains a qualified empirical claim.
Response to Reviewer 2fP3 (3)
W3 and Q4. OTMorph, TransReg, and the overall ranking.
We agree that the main RDP configuration and the best augmented backbone must not be conflated. The additional OTMorph comparison is:
| Setting | Method | DSC ↑ | HD95 (mm) ↓ | ASSD (mm) ↓ | NJD (%) ↓ |
|---|---|---|---|---|---|
| Learn2Reg | OTMorph | 0.630 | 12.261 | 4.696 | 0.050 |
| Learn2Reg | RDP + TransNet | 0.658 | 11.740 | 4.324 | 0.030 |
| AbdomenCT-1K CT/AMOS MR | OTMorph | 0.503 | 11.490 | 4.312 | 0.075 |
| AbdomenCT-1K CT/AMOS MR | RDP + TransNet | 0.583 | 10.192 | 3.646 | 0.039 |
These results favor RDP+TransNet over the evaluated OTMorph implementation under our experimental settings. They do not establish a universal ranking across datasets or implementations.
Our current experiments do not include a verified implementation of TransReg, so we cannot claim superiority over it. We will explicitly identify this missing comparison. We will also discuss its conceptual overlap: TransReg combines original-pair and translated-pair registration pathways, whereas our module mixes features before an existing deformation decoder. This distinction describes the design; it is not a substitute for a head-to-head result.
For Learn2Reg, unmodified ModeT and PCNet score 0.688 and 0.692 DSC, respectively, both above RDP + TransNet at 0.658. Adding TransNet improves them to 0.704 and 0.703. In the second setting, unmodified CorrMLP also has better HD95/ASSD than RDP + TransNet. We will include these stronger configurations in the consolidated comparison and remove the blanket SOTA claim rather than transfer it to whichever configuration has the largest DSC. The supported finding is consistent within-backbone improvement, with ModeT + TransNet achieving the highest Learn2Reg DSC among our evaluated configurations.
Q5. Residual tissue-specific differences, particularly cortical bone.
Your observation is valid: globally similar histograms do not guarantee that corresponding tissues acquire the same contrast, and the examples indicate that cortical bone can remain relatively bright. A global histogram specifies intensity frequencies but does not assign those intensities to tissue identities. Our current evaluation therefore does not establish tissue-specific CT-to-MR equivalence or successful normalization of cortical bone.
The positive organ-registration results show that the representation can be useful despite residual contrast differences. They do not prove that bone contrast is correct, that bone boundaries are preserved, or that bone-driven registration would improve. We will explicitly state this limitation and describe TransCT as a registration-oriented contrast transformation rather than an anatomically and radiologically equivalent MR synthesis. Tissue-specific assessment is needed before making a stronger claim about bone or other structures outside the reported organ evaluation.
Response to Reviewer 2fP3 (1)
Thank you for focusing on the evidence needed to distinguish the transformation mechanism from the overall pipeline. We agree that the strongest test combines comparisons with a common registration backbone and evaluation of the intermediate image, while keeping the claims within the scope of each measurement. We group overlapping weaknesses and questions below to avoid repeating the same result.
W1, Q1, and Q2. Synthesis and direct histogram matching with the same registration backbone.
Response. We compared raw CT, direct CT-to-target-MR histogram matching, a CycleGAN-based transformation, and TransNet using RDP as the common registration backbone. For direct matching, the registration network was retrained with the matched images. For CycleGAN, the synthesized images replace TransCT as the auxiliary image input.
On Learn2Reg, TransNet exceeds the tested direct-matching and CycleGAN configurations by 0.058 and 0.048 DSC, respectively, and has lower HD95, ASSD, and NJD. Direct histogram matching only changes DSC from 0.597 to 0.600. This is evidence that simple matching of marginal intensity distributions is insufficient to reproduce the gain in this setting.
These comparisons hold the registration backbone fixed, but compare complete transformation configurations with different training objectives. They support an advantage over the tested alternatives, not an isolated causal attribution to histogram conditioning or a claim that all synthesis approaches are inferior. We will specify the feature paths, registration losses, transformer training/freeze policy, and training budgets for each configuration so that the extent of matching is explicit. To answer the ablation question directly, the “w/o MR-hist” variant removes only the histogram input and retains EMD. The additional ablations are:
The results separate conditioning from histogram-based supervision: conditioning contributes an additional 0.009 DSC when EMD is retained, while removing EMD with conditioning retained decreases DSC by 0.016. They support the tested combination without implying that all of its gains arise from conditioning alone.