- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper studies geometry aware score-based generative modelling. A method that first perturbs the data in the normal direction to the manifold, then applies the standard OU process is proposed and analysed. Minimax rate up to logarithmic factor is established for -Holder integral probability metrics for . Experimental validation is consistent with geometry aware perturbation being useful.
Critical strengths
- Nice result showing that geometric aware perturbation which is anistropic rather than isotropic obtains minimax rate up to log factor. As far as I can tell, this is novel.
- Practical variant of the method shows advantage on initial synthetic and a real world dataset. The advantage is not large compared to just using projection (as has been done in practice), but could still potentially be practically useful. (Update after asking AI for a review: I would down-weight this as the AI review pointed out that normal-direction perturbation followed by ambient generative modeling and projection already appears in Keegan and Ruthotto, although manifold is known in this case.)
Critical weaknesses
No critical weaknesses that I am aware of but writing should be improved, e.g. Assumption A1 is not defined but is used in the main paper (minimally a summary of what the assumption is should be provided before use, with pointer to the appendix for the full details).
Questions for authors
- What would the implication on the results be if the intrinsic dimension d is not known?
- Would running more reverse sampling steps for smaller be helpful in the experiments?
- (Update after AI review) How is the practical method used in the experiment different from the closest practical geometry-aware diffusion methods from prior works?
3 comments
Thanks for the answers. I retain my positive review of the paper.
Thank you for your positive assessment and thoughtful questions. Your comments helped us extend and clarify our results.
We thank the reviewer for their careful reading and assessment of the paper. We have revised the paper with a focus on the presentation, including care around stating the assumptions with reference to the appendix. We have also clarified that we study the normal perturbation method and not claim methodological novelty. We address the questions below.
Question 1: Our guarantees assume that the intrinsic dimension d is known. If d is unknown, a possible extension is to estimate it from the geometry-estimation sample and use d in the reconstruction and other dimension-dependent choices. On the event d=d, this procedure agrees with the known-dimension estimator. Provided that the output remains supported in a fixed bounded set, including on failure events, dimension misclassification contributes at most a constant times P(d=d) to the expected dγ error. Thus, a uniform O(n−1/2) bound on this probability is sufficient to preserve our rates.
Such rapid dimension estimation is possible under suitable assumptions: Kim, Rinaldo, and Wasserman (2019) establish error probabilities of order O(n−cn), for some c>0, in a noiseless manifold model. This suggests that estimating the dimension should not worsen the statistical rate. Incorporating dimension estimation into our theorem would require an estimator with a sufficiently small dimension-misclassification probability under our assumptions, together with a procedure that remains well-defined and has uniformly bounded output support when the estimated dimension is incorrect. Kim et al. provide one possible choice, subject to verifying their regularity conditions. We discuss this potential extension after Theorem 3.4.
Question 2: Thank you for this suggestion. Smaller values of γ penalize small spatial discrepancies more strongly, motivating us to examine whether additional steps improve accuracy under these metrics. Since γ specifies only the evaluation metric, we evaluate the same generated samples for every γ.
We conducted a reverse-step sensitivity study on the Swiss roll, Klein bottle, and Fourier curve added in the revision for Models B and C over three training seeds, using 500, 2000, 4000, and 8000 Euler--Maruyama steps at a fixed stopping time τ=10−3. We held the trained networks, perturbation scales, fitted geometry, and held-out observations fixed, and coupled Brownian paths across step counts. Each evaluation used 2000 generated samples and 2000 held-out observations per seed.
The table reports the largest absolute percentage change in mean empirical error from 500 to 8000 steps, across both models and the values of γ in each column.
Here, the six values are γ∈{0.05,0.1,0.25,0.5,0.75,1}. Additional steps slightly improve the Klein-bottle results; changes on the other datasets are small and mixed. We therefore find no consistent improvement in held-out distributional accuracy or stronger benefit for smaller γ in these settings.
Question 3: Like Keegan and Ruthotto (2026), we perturb training data in normal directions, fit an ambient generative model, and project generated samples onto the manifold. The practical difference is how we obtain the geometry: they derive normals and projection from supplied geometric constraints, whereas we estimate both from observations. In the synthetic experiments, we specify a manifold family and estimate its parameters from a separate geometry sample. For alanine dipeptide, we assume no global manifold family: we use the working dimension d=2 and fit local quadratic patches to Cartesian observations. In both settings, the same fitted geometry determines the perturbation directions and final projection.
Liu et al. (2025) also exploit normal–tangential geometry: Niso-DM adds normal-direction noise, while Tango-DM trains only the tangential score at small noise levels. Our construction is closely related to Niso-DM; we analyze normal perturbation followed by standard ambient diffusion and final projection, including finite-sample guarantees with estimated geometry. Models B and C share the fitted geometry and final projection, allowing us to assess the additional effect of normal perturbation.
Our principal contribution is the finite-sample statistical analysis: neural score approximation and estimation, propagation to distributional error, and minimax guarantees up to logarithmic factors, including estimated geometry under explicit reconstruction assumptions.
Reference: Kim, J., Rinaldo, A., and Wasserman, L. (2019). Minimax Rates for Estimating the Dimension of a Manifold. Journal of Computational Geometry, 10(1), 42–95.