- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Wasserstein Gradient Flows (WGF) into Drifting Models, extending them to Riemannian manifolds. The authors first formulate WGF on Riemannian manifolds. They then consider three different distributional objectives and derive the corresponding drift fields. Experiments are conducted on the Earth, Binary-MNIST, CIFAR-10, and LM1B datasets, achieving competitive results.
Critical strengths
The paper extends Drifting Models to Riemannian manifolds and derives the drift fields from explicit objectives rather than starting from kernel functions. The method can also work on general manifolds where geodesics are not available in closed form. It achieves competitive results on image and language generation tasks.
Critical weaknesses
The authors mention that they use relatively small datasets due to limited computational resources, which is understandable. However, the experiments cover too few types of manifolds. Based on existing Riemannian generative models, I suggest adding experiments on the torus, SO(3), and SE(3)^n. These datasets are also relatively small, so running additional experiments should be feasible.
The paper proposes three different drift fields. On the Earth benchmark, no single method consistently performs the best across all datasets. However, R-WGF-Sinkhorn is selected as the best-performing method for the remaining tasks. Is there any theoretical explanation or empirical evidence that can help determine which drift field will perform best for a given task before training?
Questions for authors
see weakness
2 comments
Kind Reminder
Dear Reviewer 7gzg,
Thank you again for your careful reading of our paper and for your thoughtful comments. We have responded in detail to each of the points you raised and hope that our rebuttal and revisions address your concerns. We would be grateful for your feedback on our response and we would welcome the opportunity to clarify any remaining points. If you feel that your concerns have been resolved, we hope you might consider a higher overall score.
Answer to Reviewer 7gzg
Dear Reviewer 7gzg, thank you for your insightful comments and for taking the time to review our work. We appreciate your high confidence and constructive feedback. Please find below the answers to your questions and comments.
[W.1] […] the experiments cover too few types of manifolds. […] I suggest adding experiments on the torus, SO(3), and SE(3)n.
Thank you for suggesting these benchmarks. In the revised manuscript, we derived the R-WGF updates for flat tori, SO(3), and SE(3)n, with drift formulas in Table 1 and derivation details in Appendix A. We evaluated our one-step generation pipeline on experimental setups adapted from Riemannian MeanFlow (RMF) [1], which Reviewer iffN also suggested as a comparison.
We tested Proline and RNA torsion angles on T2 and T7, respectively, Fisher and Swiss Roll rotations on SO(3), and ACRONYM grasps on SE(3). We also added a synthetic benchmark for joint generation of four correlated rigid poses on SE(3)4. The table below shows one-step results.
R-WGF results are mean ± SD over five training seeds. The RMF results on SE(3)4 and ACRONYM use our adapted implementation. The other baseline values are from [1].
At one model evaluation, the best R-WGF variant achieves lower reported MMD than the published baselines on all four torus and rotation benchmarks. R-WGF-Sinkhorn leads on Proline, RNA, and Fisher, and R-WGF-MMD leads on Swiss Roll. On SE(3)4, R-WGF-Sinkhorn lowers scaled joint MMD$^2$ from 4.3 to 3.7 relative to the adapted RMF control. On ACRONYM, we reran RMF using the authors' released code and evaluated both methods on the same test split with the same evaluator. R-WGF-Sinkhorn achieves 84.10±2.63% Success@20, compared with 70.30±5.25% for our RMF rerun. For reference, the RMF paper [1] reports 65% grasp success. Section 5.4 of the revised manuscript summarizes the new experiments, and Appendix B provides the evaluation protocols and full results. Also, Figure 6 shows examples of one-step generation.
[W.2] Is there any theoretical explanation or empirical evidence that can help determine which drift field will perform best […]?
Under the stated assumptions, all three objectives are minimized at the target distribution, and each exact population flow decreases its own objective. In practice, we estimate the drifts from finite samples and take discrete steps, so the relative performance depends on the task and training setup. Sinkhorn uses a transport cost to match generated and data samples, which is useful when the cost reflects meaningful differences between samples. MMD uses kernel averages, so it is easy to estimate from samples and depends on the kernel scale. KL moves samples according to the difference between the data and model scores, which must be estimated reliably.
Our experiments show that the best choice varies across tasks. The best drift varies across Earth datasets even on the same sphere, and KL achieves the lowest FID on Binary-MNIST. Sinkhorn was selected for full training after performing best in the CIFAR-10 and LM1B pilots. In Table 5, Sinkhorn leads on five of six benchmarks and MMD on Swiss Roll. For a new task, we suggest comparing the fields in short pilot runs with the same architecture and budget, then choosing based on a prespecified validation metric.
[1] Riemannian MeanFlow (RMF, https://arxiv.org/abs/2603.10718)
[2] RFM (https://arxiv.org/abs/2302.03660)
[3] G-LSD (https://arxiv.org/abs/2510.21608)
Concluding remarks. Thank you for your feedback. We derived the R-WGF updates for tori, rotations, and rigid poses and benchmarked our one-step generators against RMF on these geometries. We would be grateful if you could let us know whether these revisions address your concerns. If so, we kindly ask that you consider increasing your rating. We are also open to discussing any other questions you may have.