- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes an optimal-transport-based generative model as an alternative to classical one-step generative models, such as VAEs. Therefore, it proposes to discretize the latent space via a discretized quantile functions to fit an OT assignment between latent quantile and data points. New samples are generated via sampling new point form the latent distribution.
Critical strengths
The idea of using quantiles to discretize the latent space with respect to the latent space has not been explored that much.
In comparison to other OT-inspired classical one-step generative models, such as Wasserstein autoencoders and Wasserstein GANs, the connection of the proposed model to optimal transport seems closer in spirit.
Critical weaknesses
Discretization of the quantile assignment is hard to scale to higher-dimensions due to the curse of dimensionality.
While the idea is interesting, the model is most certainly not competitive with current one-step model. While I do not think that performance is the only evaluation metric, the underlying theory is not sufficient to justify interest in the model (in my personal opinion).
The model is not even compared to other OT-inspired methods: MinibatchOT Flow Matching (Tong et al), Neural Optimal Transport (Korotin et al), Wasserstein Autoencoders (Tolstikhin et al), ...
The fundamental definition of a multivariate quantile function is not explained in the main text.
There is a link that points to "Anonymous GitHub" for code, but I could not find anything.
Minor:
- One should clarify that iterated optimization procedure wrt to theta and pi does not lead to global optimization. Additionally, blockwise optimization leads to further relaxation.
Questions for authors
Given that I am only supposed to ask "questions whose answers could materially affect your assessment," I have no questions.
While the comments above reflect my own assessment, I would like to point out that ICLR offers a rather good LLM-based paper precheck service (the "Paper Assistant Tool," or PAT). Although my main concerns are conceptual, I think the paper could have benefited from careful use of this service.
On a more personal note, I think the proposed model builds on some genuinely interesting ideas! :) Given the remarkable progress in generative modeling over the past years, and the steady refinement of model architectures from VAEs and GANs to flows and diffusion models, competing with established approaches is certainly no easy task. I hope the authors find my comments helpful in further developing their ideas.