acceptodds
Under review as a conference paper at ICLR 2027

Intrinsic Wasserstein Rates for Score-Based Diffusion Models on Smooth Manifolds

Abstract

Many high-dimensional data distributions are supported on low-dimensional manifolds, whereas diffusion models learn score functions in the ambient space. This raises a basic question: can empirical risk minimization over ambient score-network classes attain a rate governed by intrinsic dimension without first estimating a manifold representation from the observations? We study this question for distributions with strictly positive -H\"older densities on compact -dimensional smooth manifolds embedded in . The main technical challenge is the low-noise regime, where the score becomes singular as the noise level vanishes. To address this challenge, we construct tangent-cell ReLU approximations at moderate and high noise and a projection-centered ReLU approximation at low noise, with explicit ambient-dimension dependence. For , under the stated geometry, regularity, and optimization conditions, the cube-projected output of the continuous-time sampler has expected -Wasserstein error up to logarithmic factors. The result therefore establishes the intrinsic sample-size exponent convergence rate for ambient score networks, without a preliminary data-dependent dimension-reduction step.

Then back it, or bet against it.

Related papers

Open the market on this paper to see 7 more related papers.