acceptodds
Under review as a conference paper at ICLR 2027

Latent Manifold Dimension from Noisy Observations: Identifiability and Recovery via Diffusion Scores

Abstract

Diffusion models trained by denoising score matching (DSM) offer a promising approach to intrinsic dimension (ID) estimation. However, when observations are not exactly supported on a manifold, two questions remain: **(Q1)** Does the observed law determine a unique latent dimension, and **(Q2)** which diffusion scales recover it? We address these questions under bounded normal tubular noise, allowing a broad range of noise distributions. For (Q1), we define *latent manifold dimension* (LMD) relative to a prescribed model class and establish a uniform reach-separation condition for identifiability that cannot generally be relaxed at its boundary. To study recovery, we first introduce *local Hessian spectral dimension* (LHSD) as a score-based dimension statistic and examine how accurately it can be estimated from data at a given diffusion scale. Under suitable regularity and thin-tube conditions, we establish its minimax estimation rate, attained by an unrestricted empirical-DSM reference estimator. We then address (Q2): LHSD can fail at fine scales and tends to zero as the diffusion scale grows, while a sharp approximation bound characterizes recovery at intermediate scales. Experiments with diffusion transformers qualitatively support this scale dependence, including accurate estimation of the latent dimension at intermediate scales.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.