- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper addresses the problem of modeling the conditional distribution of high-resolution data given its low-resolution version. The starting point is the mean–residual decomposition where one first predicts the mean of the conditional distribution and then models the residual using a family of distributions (e.g. diffusion models). The idea being that it is easier to find the distribution of the residual since its variance is lower, because the conditional mean was already approximated in the first step. The paper argues that one issue with this approach is that this two-stage approach, which fixes the conditional mean before matching the residual, neglects taking into account that the conditional mean was computed using only training data rather than full data distribution. The paper provides an analysis of the spread–skill ratio to motivate this issue. The proposed solution is use calibration data (separated from training data) and then compute the optimal transport coupling between the training and calibration data (in practice, a low-dimensional PCA representation). Using this coupling the training data is readjusted to pseudo training samples which are then used for modeling the distribution of the residuals. The idea is that the calibration data adjustment helps mitigate the fact that the conditional mean was trained on only the training data. The paper compares this method on the BLASTNet dataset (synthetic benchmark) and the ERA5 dataset (real-world atmospheric downscaling task) against a number of baselines and shows that the propose dmethod is competitive.
Critical strengths
The proposed ReMatch method shows good performance in the experiments considered in the paper.
Critical weaknesses
On a high level the paper mixes a number of ideas. The first idea is to use calibration data to mitigate the residual shift. The second idea is to use optimal transport for the latter. But the motivation for optimal transport is not very clear to me. Supposedly, the analysis of the spread–skill ratio shows that W_2 can bound various quantities that appear in this analysis, but the connection seems somewhat tenuous. Thus, it is not clear whether one could take any of the probabilistic baselines methods and use calibration data to readjust them in another way. Indeed, optimal transport is computationally expensive so finding different ways to use calibration data could turn out to be much more useful.
Questions for authors
See Critical Weaknesses.
Dear Reviewer,
We would appreciate your feedback on whether our responses and clarifications have adequately addressed your concerns. If so, we would be grateful if you could consider raising your score.
Thank you again for your time and consideration.