- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a CT-to-PET synthesis framework that refines a frozen ResUNet prediction using a residual SiT. PET-DINO feature differences supervise what to recover, while an activation gate controls where residual corrections are applied.
Critical strengths
-
Well-motivated refinement strategy. The idea of improving an initial PET prediction by selectively correcting its errors is reasonable. PET-DINO is only used during training, adding no extra cost at inference.
-
Comprehensive experimental evaluation. The experiments cover external evaluation, high-SUV reconstruction errors, and downstream classification. The improvements in high-SUV regions are particularly encouraging and support the motivation of the proposed method.
Critical weaknesses
-
Limited methodological novelty. The proposed method mainly combines existing techniques, including residual generation, SiT, representation alignment (REPA), and spatial gating. While the motivation is reasonable, the overall contribution appears relatively incremental, with limited new methodological insights beyond integrating these components.
-
Insufficient validation of the core claims. Although the ablation study demonstrates performance improvements, it provides limited insight into how the proposed "what to recover" and "where to refine" mechanisms actually work. More in-depth analysis of the learned residual representations and activation maps is needed to directly validate these central claims, rather than relying mainly on performance gains.
Questions for authors
-
Section 4.4 mainly reports performance improvements without sufficiently explaining why the proposed "what to recover" and "where to refine" mechanisms work. More in-depth analysis would strengthen the core claims, such as comparing residual alignment with full-target REPA-style alignment and PET-DINO perceptual loss, and spatial gating with a learned global scalar. Additional quantitative results on global and high-SUV errors, together with visualizations of predicted residuals, activation maps, and refinement regions, would provide more direct evidence of the effectiveness of these mechanisms.
-
Please report the training wall-clock time and inference latency, including the cost of ResUNet pretraining and residual refinement, with comparisons to representative baselines.
-
Please provide more details on the ResUNet architecture and training configuration. Its standalone CT-to-PET generation performance should also be clearly reported on both datasets.
-
How was PET-DINO obtained? Please clarify its pretraining dataset, training procedure, and whether it was trained from scratch or fine-tuned from an existing model.
-
Could the authors provide a sensitivity analysis of in Eq. (29) to further assess the robustness of the proposed residual alignment?
4 comments
Q5: Thank you for the comment. We adopt to balance semantic representation supervision and the primary flow-matching objective. The three internal REPA components are assigned fixed weights of 0.45, 0.45, and 0.10 to capture complementary aspects of semantic residual alignment. We emphasize that the effectiveness of this design is already verified through the controlled ablation study in Table 4, where removing Residual Alignment while keeping the other components unchanged leads to consistent performance degradation. Specifically, PSNR decreases from 32.562 to 28.247 dB, SSIM from 0.8742 to 0.7935, and PCC from 0.8964 to 0.7859. These results provide direct evidence that Residual Alignment makes a substantial contribution to the proposed framework. Thus, is used as a fixed auxiliary supervision weight, rather than as an independently optimized parameter.
Thank you for the comprehensive and complete rebuttal, which has addressed some of my concerns. However, the paper still suffers from weak methodological novelty and insufficient mechanism analysis. Thus, I will keep my original rating.
We appreciate the reviewer's candid assessment. We would like to clarify that our contribution does not lie in introducing a new standalone backbone, but in formulating an anchor-conditioned residual refinement framework with two explicitly disentangled objectives.
(1) Anchor-relative semantic residual learning. Unlike conventional full-target generation or standard feature alignment, we explicitly model the semantic discrepancy between the ground-truth PET and the frozen anchor PET, defined as . By combining absolute feature alignment with residual direction and magnitude alignment, our method preserves global target semantics while specifically guiding the generator to recover information missing from the anchor prediction. This provides a task-specific semantic supervision strategy for residual generation.
(2) Spatially adaptive correction localization. Our Activation Gate is not designed to identify high-metabolic regions, but to estimate where the anchor prediction requires correction. Conditioned on both CT and anchor PET, it predicts a spatially varying modulation map , which selectively controls the application of generated residuals. This distinguishes correction localization from conventional attention-based metabolic region identification.
(3) Complementary integration. These mechanisms address two distinct but interdependent questions: Residual Alignment determines what semantic information to recover, while Activation Gating determines where to apply the corrections. Their integration produces the final prediction , enabling selective refinement while preserving reliable anchor predictions.
Therefore, the methodological contribution lies in the anchor-relative semantic supervision and spatially selective correction formulation, rather than the individual use of established network components. We believe this distinction is central to understanding the novelty of our framework.
Q1: We thank the reviewer for this constructive suggestion. We agree that understanding the mechanisms behind what to recover and where to refine requires more than global reconstruction metrics.
(1) Mechanistic explanation.
As discussed in Section 3.3, Residual Alignment combines absolute feature alignment with residual direction and magnitude alignment. The absolute term preserves global target semantics, while the residual-specific terms guide the generator toward missing semantic corrections relative to the anchor PET. Unlike output-level perceptual supervision, it directly guides the generator's internal representations. Furthermore, the spatially varying Activation Gate (Section 3.4) selectively modulates residual corrections, whereas a global scalar would apply uniform modulation across locations.
(2) Additional quantitative evidence.
We have extended Table 4 and Section 4.6 (p. 10) with component-wise reconstruction errors at SUV>1 and SUV>2.5. Compared with the anchor baseline, Full Fusion reduces MAE/RMSE by 28.3%/33.5% at SUV>1 and 37.7%/43.6% at SUV>2.5. Individual components show different trade-offs, while their combination achieves the lowest errors across all four regional metrics. Figure 5 additionally illustrates the qualitative progression of residual refinement.
We acknowledge that direct comparisons against full-target REPA, PET-DINO perceptual loss, and learned global-scalar gating, together with explicit residual and activation-map visualizations, would provide stronger evidence isolating the individual mechanisms. These comparisons are not included in the current results, and we limit our conclusions accordingly.
Q2: Thank you for the suggestion. We have added a computational complexity and runtime analysis in the Appendix, reporting model parameters, GFLOPs, and inference latency for representative baselines. Our method requires 61.914M parameters and 1,531.15 GFLOPs, with an inference latency of 264.737 ms. It achieves 4.76× and 1.84× faster inference than BBDM and FastDDPM, respectively. We also clarify the training cost of both stages: approximately 2 hours for ResUNet anchor pretraining and 5 hours for Residual SiT refinement, resulting in a total training time of approximately 7 hours. These additions provide a more comprehensive assessment of the computational cost of our framework.
Q3: Thank you for this suggestion. We have expanded Appendix B to provide a detailed description of the ResUNet architecture and its independent training configuration. Specifically, we clarify its five-stage residual encoder, four-stage decoder, channel dimensions (64/128/256/512/512), residual blocks, normalization and activation layers, and skip-connected upsampling strategy. We also provide the training details, including the input resolution, batch size, learning rate, weight decay, loss composition and coefficients, mixed-precision setting, and EMA configuration. These additions clarify how the deterministic CT-to-PET backbone is constructed and trained before being frozen as the anchor generator for subsequent residual refinement.
Q4: We thank the reviewer for this important question. We have clarified the pretraining dataset and architecture of PET-DINO in the revised manuscript.
Specifically, PET-DINO is pretrained on PET images from 168 lung cancer patients in the AutoPET dataset. It adopts a ViT-B/16 architecture with 12 Transformer blocks, a 768-dimensional embedding space, 12 attention heads, and a patch size of 16×16.
During downstream CT-to-PET training, PET-DINO is kept completely frozen and serves exclusively as a feature teacher for Residual Alignment. Specifically, it extracts representations from the ground-truth PET and the generated anchor PET, and their feature difference provides the semantic residual supervision for Residual SiT. Its parameters are never updated during downstream optimization, and the entire PET-DINO pathway is removed during inference.
We have added these details to the revised manuscript to improve the transparency and reproducibility of our approach.