- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper considers the problem of learning conditional generative models under changes in the train and test distributions. They propose a methodology called importance-weighted conditional variational autoencoder (IWCAE), together with learning and inference algorithms. For sampling–importance–resampling inference, they prove that as the number of samples tends to infinity, their algorithm's samples converge in distribution to the desired distribution. Experiments using their method are then performed in three different domains with different data modalities, showing superior performance compared with some baselines.
Critical strengths
- The problem is clearly interesting and important.
- The central proposal and its motivating modeling assumption (Conditional invariant representation) appears sound and reasonable.
- The results appear to suggest some efficacy of the proposed method.
Critical weaknesses
- Relation to literature: the paper assumes a lot of background in generative modeling, and in particular how the new method compares with existing works is not clearly described for those unfamiliar.
- Discussion of experiments in introduction: there is no discussion of the experimental results in the introduction other than a single sentence in the 'contributions' list. There should be such discussion. It also makes it harder to assess what the central claims or conclusions of the experiments are.
- Exposition of what the experiments show is lacking even in the later sections. For example, what are the methods against which you compare? You simply list them without discussing how they relate to your method.
Questions for authors
List of comments:
- “Experiments on three medical datasets with heterogeneous data modalities the effectiveness of IWCAE for conditional generative prediction under cross-domain distribution shifts.” Has some grammatical typo.
- The introduction does not discuss your experiments at all until there is one sentence about them in the ‘contributions’ list. They should be discussed in the introduction
- “where testing responses are unavailable during training” This is slightly confusing, since, presumably the testing inputs are not available during training.
- The phrase “is related to invariant representation assumptions commonly used in domain adaptation” seems to be claiming an important relationship of your work to existing work, but is not discussed in any more detail. Can this relationship be explained in more detail?
- “We therefore introduce a latent variable Z to capture the residual information in X that is not encoded by τ (X)” This doesn’t make sense to me. What is the difference between \tau(X) and Z. How do their responsibilities differ. In fact, in equation (2), it seems to me that the only way for information in to flow to is through the representation . In other words, there is no way for Z to contain information about other than that contained in .
3 comments
Response to Questions
4: Our assumption is closely related to invariant representation learning in domain adaptation, where a transformation is sought to preserves prediction information while reducing the discrepancy between representations across domains. The mapping may represent a low-dimensional linear or nonlinear transformation of the input or, when is a masking operator, a subset of the original covariates (Pan et al., 2010; Long et al., 2014; Peng et al., 2019; Wu et al., 2025). Since our assumption accommodates these commonly used forms of invariant representations, it provides a more general formulation encompassing different representation structures. We have revised the statement to Section 3.1 to clarify the relationship between our assumption and existing domain adaptation approaches.
5: In our framework, represents the observed predictors, whereas is a latent variable introduced to capture residual variation in that is not fully explained by . Such information may include the effects of predictive factors in that are not preserved by the transformation .
Specifically, as shown in Eq (2), the posterior is conditioned on both the transformed predictors and the observed response. Since the response may depend on components of that are not retained by , conditioning on can provide additional information about these omitted components, allowing to represent their contributions to the conditional outcome distribution.
For example, consider with and . Although is not included in , it contributes to . Consequently, the posterior distribution of given can capture information associated with through its contribution to , allowing the model to characterize residual variability that is not fully explained by .
We have revised the corresponding statement to clarify this distinction.
Dear Reviewer,
We understand that you have a busy schedule. As the discussion period is approaching its end, we would greatly appreciate it if you could take a moment to review our rebuttal and share any further thoughts or concerns. Thank you again for your constructive feedback, which has helped us substantially improve our manuscript.
We sincerely thank the reviewer for the constructive comments and valuable suggestions. We provide point-by-point responses to the raised concerns and questions below.
Response to Critical Weaknesses
1: We agree that a clearer discussion of the relationship between IWCAE and existing methods would help readers better understand the methodological contributions of our work.
Our framework is closely related to three lines of research: conditional variational autoencoders (CVAEs), importance-weighted variational inference, and invariant representation learning for domain adaptation. Our primary goal is to extend conditional generative modeling to settings involving domain shift by learning an invariant representation of the predictors.
A key methodological distinction of IWCAE lies in incorporating an importance-weighted variational approximation into conditional distribution learning under domain shift. Since CVAEs aim to model conditional outcome distributions, incorporating an importance-weighted training objective provides a tighter variational lower bound on the conditional log-likelihood, potentially improving conditional distribution estimation given the learned invariant representation. By jointly optimizing this objective and representation alignment, IWCAE integrates importance-weighted conditional generative modeling with invariant representation learning to facilitate distributional prediction under domain shift.
2: We have added a discussion of the experiments to the Introduction, immediately following the description of the proposed IWCAE framework, highlighting the applicability of IWCAE across different medical data modalities.
3: Due to the page limit, we initially provided only brief descriptions of the compared methods in the main text, with additional details on the construction of IWCAE and the architectures of the baseline methods presented in Appendix A.3.
For the first two experiments, the first compared method serves as the base prediction model, while the remaining four methods are domain adaptation approaches built upon the same base architecture. These comparisons allow us to evaluate the effectiveness of IWCAE relative to both the original prediction model and existing domain adaptation methods. For the third experiment, we select four established models for 4D Flow MRI super-resolution to evaluate the predictive performance of IWCAE under domain shift. Among these methods, 3D U-Net serves as the base architecture for both DSR and IWCAE, while 4DFlowNet is another established architecture that has demonstrated strong performance in 4D Flow MRI super-resolution, with Bagging representing an ensemble-based variant of 4DFlowNet. Since training on computational fluid dynamics (CFD) data and testing on 4D Flow MRI data is a commonly adopted setting for this task, all four baseline methods are evaluated under the same simulation-to-real domain shift.
We have expanded Appendix A.3 to provide more detailed descriptions of the baseline architectures and explain how they relate to IWCAE.
Response to Questions
1: Thank you for pointing out this grammatical error. We have corrected the sentence in the revised manuscript.
2: We have added a brief discussion of the experiments in the Introduction, immediately following the description of the proposed IWCAE framework, to better highlight its applicability across different medical data modalities.
3: Our work considers an unsupervised domain adaptation setting, where labeled samples from the training domain and unlabeled inputs from the testing domain are available during training, while the corresponding testing-domain responses remain unobserved. The unlabeled testing-domain inputs are used to facilitate distributional alignment between the training and testing domains.
This setting is particularly relevant to medical data analysis, where unlabeled data are often abundant, but obtaining corresponding ground-truth labels or responses can be costly and time-consuming. For example, low-resolution medical images may be readily available, whereas acquiring corresponding high-resolution reference images requires additional imaging resources. Similarly, large collections of clinical notes may be available, but obtaining reliable diagnostic labels requires expert annotation. These practical challenges motivate our consideration of unsupervised domain adaptation.