- Rating
- 3
- Confidence
- 3(+1)
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents StreamRefine, a framework for adaptive refinement in 3D medical image translation. The method uses Continue-to-Check training, which occasionally continues beyond a proposed stopping point so that later refinement states can still receive supervision. A lightweight stopping head predicts whether further refinement is useful based on translation improvement, anatomical change, and computation cost. The method is evaluated on BraTS 2024, SynthRAD 2025, and AutoPET across multiple translation tasks. The experiments compare StreamRefine with existing translation methods and matched internal baselines, and further analyze the effects of continuation, anatomy-aware stopping, later-step learning, and inference efficiency.
Critical strengths
- Continue-to-Check occasionally extends training beyond a proposed stop, so later refinement states remain supervised while the stopping head also receives useful targets. The Naive, Head-only, Refiner-only, and Joint comparisons directly examine these two effects.
- Experiments span BraTS, SynthRAD, and AutoPET with multiple translation directions, matched internal baselines, downstream segmentation, and efficiency measurements. The results are consistent across these settings and support the claimed balance between translation quality and computational cost.
Critical weaknesses
- Tables 1–2 list only modest improvements over the matched internal baselines, and StreamRefine is not best on every reported metric. The gains are relatively small considering the additional components introduced by the method.
- PIR is used to define the anatomy-aware stopping target across several modalities, but its direct validation against independent structural measures is only reported for one BraTS translation direction. Its reliability outside this setting remains less clear.
Questions for authors
- How does the stopping policy affect the refinement process during training?
- How much of the gain comes from adaptive stopping, and how much comes from later-step supervision?
4 comments
Response to Reviewer DUxz (Part 2/2)
Q1: The effect of stopping policy on the refinement process.
Thank you for this insightful observation. During training, the stopping policy determines which refinement states are executed and receive direct supervision. Naive early stopping truncates training trajectories, leaving later refinements undertrained and potentially reinforcing premature stopping. Our Continue-to-Check training addresses this by occasionally continuing beyond proposed stops, allowing otherwise skipped refinements to receive direct supervision (Sec. 3.3, pages 4–5).
We clarify that we have already analyzed this effect experimentally in the current manuscript:
-
Training supervision (Appendix E.1, Table 20, page 27): Under matched training FLOPs, StreamRefine increases the execution frequency of Step 4 from 15.6% to 28.2% and its direct supervision count from 105k to 169k, compared with Naive Stop.
-
Refinement quality (Sec. 4.4, Fig. 5, pages 7–8): With stopping disabled during evaluation, StreamRefine improves final-step PSNR by 0.35 dB over Naive Stop. The shared-prefix analysis further confirms that most of this improvement comes from stronger later refinements rather than better earlier states.
These analyses demonstrate that the stopping policy affects refinement learning by controlling access to later-state supervision, while occasional continuation prevents useful later refinements from being undertrained. We believe these analyses clarify how the stopping policy affects refinement learning during training. We would also welcome any suggestions for additional analyses that could further illustrate this effect.
Q2: Gains from adaptive stopping and later-step supervision.
We appreciate your helpful comment. Later-step supervision primarily improves refinement quality, whereas adaptive stopping mainly improves inference efficiency while preserving quality. Our current manuscript disentangles these contributions through controlled experiments in Secs. 4.4–4.5 (pages 7–9).
-
Later-step supervision (Sec. 4.4, Fig. 5, page 8): With stopping disabled and refinement depth fixed, Head-only, Refiner-only, and Joint improve PSNR over Naive Stop by 0.07, 0.28, and 0.35 dB, respectively. This indicates that direct later-step supervision accounts for most of the refinement-quality improvement, while improved stopping feedback provides a complementary benefit.
-
Adaptive stopping (Sec. 4.5, page 9): For the same CtC-trained refiner, adaptive stopping reduces the average refinement steps from 4.00 to 2.13, with only a 0.08 dB PSNR decrease compared with full-depth refinement. Thus, its main contribution is improving inference efficiency while largely preserving translation quality.
Overall, these analyses show that later-step supervision primarily improves refinement quality, whereas adaptive stopping mainly improves the quality–efficiency trade-off. We believe our existing experiments separate their respective contributions and welcome suggestions for further analysis.
We thank the reviewer again for the constructive comments, which have helped us strengthen the validation and clarify the contributions of our paper. We hope these responses help clarify the points raised and welcome any further questions or discussion.
Thank you for the detailed response. These address some of my concerns and help clarify the role of each component. I am keeping my original score and raising my confidence to 3.
Thank you for your thoughtful follow-up and for taking the time to reconsider our responses. We appreciate your constructive comment and are glad that our clarifications helped address some of your concerns.
Response to Reviewer DUxz (Part 1/2)
We appreciate the reviewer’s recognition of CtC’s dual role in later-refinement and stopping-head training, as well as our broad evaluation and controlled analyses. Some questions, particularly regarding the effects of stopping and later-step supervision, may stem from aspects of our existing analyses that were not sufficiently clear, which we clarify below. We have also extended PIR validation to two additional tasks and further discussed the modest gains and limitations.
Summary of Key Concerns and Main Responses
W1: Modest improvements.
Thank you for highlighting this issue. We agree that the improvements over the matched internal baselines in Tables 1–2 are modest, and that StreamRefine does not achieve the best result on every reported metric. We would like to clarify their value in two respects.
The gains span translation fidelity, anatomy-related performance, and inference efficiency. Tables 1–3 and Fig. 4 show a consistent overall trend toward a better balance among these objectives across the evaluated tasks. For instance, on BraTS T2w→T2f, StreamRefine improves both PSNR and downstream Dice over Fixed-K Refine while reducing the average number of refinement steps by approximately 47%. These joint benefits help explain the value of the additional training components. Moreover, inference requires neither continuation checks nor PIR computation, using only a lightweight head to determine when to stop (Sec. 3.4).
Controlled analyses explain how the proposed mechanism contributes to these gains. Secs. 4.4–4.5 (Figs. 5–7) on pages 8-9 provide quantitative and qualitative evidence for the roles of later-step supervision and adaptive stopping. Fixed-depth and shared-prefix experiments show that occasional continuation strengthens later refinements, while stopping-regret analyses and step-by-step visualizations show how the learned head selects useful refinements and helps avoid unnecessary anatomical changes. Together, these analyses support the complementary contributions of learning to refine further and learning when to stop.
We have added a discussion of the modest gains and their limitations to Appendix F (page 32). Taken together, the joint benefits and controlled analyses support the practical value of these gains within the evaluated settings. We appreciate your perspective and welcome further discussion and suggestions for strengthening this assessment.
W2: Additional validation of PIR.
Thank you for raising this important concern. To further assess the generalizability of PIR, we have expanded its validation beyond the original BraTS T2w→T2f setting to two additional tasks, covering different translation directions and imaging modalities. The new results are provided in Appendix E.2 (Table 21, page 28), where we examine the agreement between PIR error and two independent segmentation-based structural measures.
Table R1: Independent validation of the PIR structural proxy across three translation tasks.
The results demonstrate consistent positive associations between PIR and independent structural errors across all evaluated tasks. Although the correlation strengths vary moderately across modalities, the overall trend remains consistent. This additional evidence strengthens the validity of PIR as an anatomy-aware stopping proxy beyond the original BraTS setting.