- Rating
- 3
- Confidence
- 3
- Informativeness
- 3(+1)
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper proposes to learn a generative model for extreme events via post-training of pre-trained models rather than via a new pre-training technique. This process is formalized via a form of distributional adaptation formalized via a Wasserstein gradient flow and executed by exploiting the variational formulation of the CVaR. The authors provide a Theorem that characterizes the gradient flow's velocity field, and they provide an experimental assessment of the proposed algorithm on both toy and real-world data, showing promising results in both settings.
Critical strengths
- The idea of learning a better model for extreme events via fine-tuning rather than pre-training seems original and interesting. I believe this is a promising direction that might influence subsequent methods.
- The proposed algorithm is principled and seems to improve models in practice on toy and small-scale domains. I believe this performance is promising for the proposed methodology and that future works could scale this idea further to more complex and higher-dim. setting.
Critical weaknesses
- (Algorithm Question) Recent works for flow and diffusion models are able to approximately execute flows in probability space without using empirical estimates of the density. But since this method seem to work also for other generative models, where a velocity field is not necessarily present (eg GANs) I am confused about its workings and have the following key question: Is the empirical distribution \hat{Q}_k ever directly estimated? Related to this, I found the presentation of the algorithm rather unclear from a procedural, computational standpoint. I suggest to replace the Equations in page 6 with a clear pseudocode where every step is explicitly written, including sampling and estimation of quantities.
- (Experiments) Experiments seem quite toysh/low-dim. While they can be of support for a theory paper, they certainly do not show convincing results for most applications in generative modeling, where typical design spaces are higher-dimensional than the ones showcased here by multiple orders of magnitude.
- (Framing agains prior literature) The proposed method seems to be a case of distributional fine-tuning as introduced in [1]. In particular, besides the different geometry of the gradient flow, the formal problem presented of CVaR-regularized divergence minimization appears to be a sub-case of the general problem introduced there for arbitrary divergences and functionals on probability measures induced by a generative model. Moreover, the specific variational expression of CVaR employed in this work has been used by prior work to adapt distributionally generative models to control CVaR functionals [2]. These prior works should likely be presented early on, rather then kept in the appendix, since the proposed methodology seems to directly build on them.
References
[1] Flow density control: Generative optimization beyond entropy-regularized fine-tuning. De Santi et al., 2025 NeurIPS
[2] Efficient tail-aware generative optimization via flow model fine-tuning. Wang et al., 2026 ICML
Questions for authors
- See the question in Weakness 1
- Is this the first method that studies how to obtain a more heavy-tailed model (or any other formalization of extreme event modeling) via post-training / fine-tuning of a pre-trained generative model?
Dear reviewers,
The author-reviewer discussion period is ending soon. If you have not done so yet, please read the authors’ rebuttal and reply to it. Tell the authors whether it addresses your concerns, and update your score if your assessment has changed. With the high number of submissions this year, your input matters more than ever.
Thank you for your time and help.
Best regards,
Your Area Chair