- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces Contrast-X, a curated benchmark for paired CT contrast synthesis and breast DCE phase imputation, with phase annotations and tumor masks. It also proposes FlowMI, which encodes observed modalities through a product-of-experts autoencoder and transports the partial-observation latent toward a full-observation latent using mask-conditioned flow matching. A trajectory reconstruction loss links interpolated latents to interpolated images. Evaluation includes image quality, downstream segmentation, held-out organs, and a reader study.
Critical strengths
- A common latent endpoint gives missing-modality learning a coherent target. Each observation subset represents partial evidence about the same patient, so transporting its latent toward the complete-data latent is a sensible way to share parameters across configurations. The reported shared-model results and trajectory-loss ablation support investigating this formulation beyond separate source-target models.
- Lesion-aware benchmarking addresses a meaningful evaluation gap. Global pixel similarity alone cannot determine whether a synthesized scan preserves the anatomy needed for analysis. Tumor masks, downstream segmentation, and the reader study provide complementary checks, making the resource potentially useful even independently of FlowMI.
Critical weaknesses
- The trajectory constraint does not establish the claimed protection against flow drift. Equation (5) trains the decoder on straight lines between encoded endpoints. An integrated learned vector field need not remain on those lines, so accurate decoding of the prescribed interpolation does not ensure reliable decoding of off-path states. Moreover, an absent modality must be embedded into a full image tensor before the image-space interpolation is defined; the paper does not specify that representation. If missing channels are filled with zero, their interpolation is an intensity ramp rather than a demonstrated physiological enhancement trajectory. The ablation supports the loss as a useful regularizer, but the stronger geometric explanation remains unestablished. Clarifying the construction and measuring decoding errors along actual inference paths would directly improve this argument.
- Patient-specific information recovery is not separated sufficiently from plausible image generation. Enhancement can contain information not uniquely determined by the available scan. Deterministic inference from the posterior mean can produce a useful estimate, but cannot by itself establish that a particular lesion's enhancement is recovered faithfully. Realism and segmentation overlap only partially address this issue. The available-input boundary is also unclear: preprocessing uses organ-specific cropping and registration, while the split description does not explicitly group all studies from a patient. These details matter because target-derived preprocessing or overlapping patients could make the apparent prediction problem easier. The CT counts in Table 1 additionally total 1,506 rather than 1,526, so the evaluation cohort needs reconciliation.
Questions for authors
- Clarification: How is a missing-modality observation represented in the full image tensor in Eq. (5), and what is the complete autoencoder loss? Does any training term constrain decoded states along the learned inference trajectory, beyond the straight endpoint interpolation?
- Evidence affecting the recommendation: Does the trajectory loss improve lesion-region reconstruction along actual inference paths, or primarily improve endpoint image metrics? A comparison of intermediate decoding and endpoint enhancement errors with and without this loss would distinguish these explanations; the current ablation is already a useful starting point.
- Clarification: Can registration and input cropping be performed using only modalities available at inference, and are all examinations of a patient kept in one partition? Please reconcile the Table 1 cohort totals and identify the timing and pre-/post-contrast status of DCE1-3.
- Evidence affecting the recommendation: What existing lesion-level results show preservation of enhancement magnitude or phase ordering, and what failures occur when that information is weak in the input? This would materially strengthen the fidelity claim beyond realism and segmentation overlap. It need not establish equivalence to clinical contrast administration.
2 comments
Response to Reviewer YNWG(2)
Question 3
Registration used CTC as the fixed image for CT and DCE2 as the fixed image for DCE, followed by visual inspection. The full registered images were retained without additional cropping. Neither organ nor tumor masks were used to define input crop regions, and we will correct the manuscript’s description of organ-specific cropping.
Because CTC or DCE2 is unavailable in the corresponding synthesis tasks, the original target-referenced registration cannot be reproduced using only the available inputs. We will explicitly describe the experiments as evaluation on registered image pairs and distinguish this setting from an input-only deployment pipeline.
All examinations, acquisition dates, and phases belonging to the same patient were assigned to a single partition. There is no patient overlap between training, validation, and testing.
The correct CT cohort count is 1,526. Rechecking the original Excel records and underlying data identified a transcription error in the pancreas entry of Table 1. This has been corrected, and the experimental data and results were unaffected.
DCE1 is the pre-contrast acquisition, whereas DCE2 and DCE3 are post-contrast acquisitions.
Question 4
The reader study reported in Table 7 of the original supplementary material provides indirect support for the clinical plausibility of the synthesized enhancement. Radiologists’ assessments indicate that the generated images approximate the appearance of real clinical scans, providing expert-based evidence complementary to pixel-level reconstruction and segmentation metrics. We interpret this as indirect support for plausible enhancement appearance.
When the available inputs provide insufficient information about lesion enhancement, failure cases include insufficient enhancement within the lesion and poorly delineated lesion boundaries. These cases illustrate the limitations of estimating patient-specific enhancement from incomplete observations.
Response to Reviewer YNWG(1)
Thank you for your careful review.
Critical Weakness 1
In Eq. (5), missing channels in the image tensor
x_0are zero-filled. Consequently, observed channels remain unchanged inx_t, whereas missing channels equalttimes their corresponding complete-image channels. This intensity ramp is a computational training target for the decoder, not a model of physiological enhancement over time. Missing modalities are excluded from PoE fusion in the encoder.To distinguish the benefit of interpolation-based supervision from that of an additional reconstruction term, we added an endpoint-target control: the decoder receives the same interpolated latent
z_t, but its target is the complete imagex_1instead ofx_t. Average PSNR across the four tasks is 25.21 dB without the trajectory loss, 26.22 dB with the endpoint target, and 26.70 dB with the interpolated target. Thus, the interpolated target provides an additional 0.48 dB over the endpoint-target control, with improvements on all four tasks.These results support the usefulness of the proposed regularization, but do not establish a guarantee against drift. We replaced “has no opportunity to drift” with a more precise statement: the loss provides reconstruction supervision along the prescribed latent interpolation and improves endpoint reconstruction in our experiments.
Critical Weakness 2
FlowMI produces an estimate conditioned on the available observations; deterministic inference does not establish unique recovery of information that those observations do not determine. We will qualify the fidelity claim and distinguish reconstruction accuracy, downstream segmentation performance, and visual realism from direct validation of enhancement magnitude or temporal behavior.
We also clarify the preprocessing and partitioning protocol. The full registered images were retained without additional cropping, and the manuscript’s description of organ-specific bounding-box cropping will be corrected. All examinations and phases belonging to the same patient were assigned to one partition, with no patient overlap between training, validation, and testing.
Registration used CTC and DCE2 as fixed references for CT and DCE, respectively. This defines an aligned-pair benchmark, and we acknowledge that target-referenced registration is not an input-only preprocessing pipeline for the evaluated synthesis tasks.
Finally, we rechecked the original Excel records and underlying data. The correct CT cohort count is 1,526; the discrepancy resulted from a transcription error in the pancreas entry of Table 1. This has been corrected and did not affect the experimental data or results.
Question 1
Missing modalities are represented by zero-filled channels in the image tensor
x_0used in Eq. (5). Withmdenoting the observation mask, the construction is:x_0 = m ⊙ x_1x_t = (1 − t)x_0 + tx_1Observed channels therefore remain equal to their values in
x_1, while missing channels equalttimes their values inx_1. This construction is a decoder-training target, not a physiological enhancement trajectory. In the encoder, missing experts are excluded from PoE fusion.The complete autoencoder objective is:
L_AE = L_rec + 0.1 × L_perc + 10⁻⁶ × L_KL + 0.1 × L_TrajectoryHere:
L_reccombines L1 and L2 reconstruction losses over all modalities.L_percis the perceptual loss, with weight 0.1.L_KLregularizes the posterior toward the standard normal prior, with weight 10⁻⁶.L_Trajectoryis the trajectory reconstruction loss defined in Eq. (5), with weight 0.1.Beyond the prescribed straight interpolation, no training term directly supervises decoded states along the integrated inference trajectory. The integrated learned field can deviate from the interpolation used during training.
Question 2
Thank you for distinguishing these explanations. We added an endpoint-target control and evaluated decoded states along actual inference paths.
The endpoint-target control retains reconstruction supervision on the same interpolated latent
z_tbut replacesx_twithx_1as the target. The average results across the four tasks are:x_1)x_t)Thus, an additional reconstruction term explains a substantial part of the improvement, while the interpolated target provides a further benefit across all four tasks.
The reported actual-path measurements do not show uniformly higher lesion PSNR at every intermediate time: the full model has lower values at
t = 0.25and0.5, and higher values att = 0.75and1.0. We therefore interpret the current evidence primarily as supporting improved endpoint reconstruction, rather than uniformly improved intermediate decoding or guaranteed protection against drift.