- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces Implicit Manifold-valued Diffusions (IMDs), a framework for approximating diffusion processes on manifolds known only through point samples. It constructs ambient-space SDEs whose drift and covariance are derived from an estimated diffusion generator and its carré du champ. The main theoretical claim is that strong-resolvent convergence of the estimated operators ensures weak convergence of the induced processes on path space. A diffusion-maps-style graph construction yields a family ranging from density-biased Langevin dynamics to manifold Brownian motion. Numerical validation includes geodesic estimation on an hourglass surface, path-distribution and geometric errors on the Stanford Bunny, density debiasing on a torus, and guided COIL-20 image interpolation using learned viewpoint augmentation.
Critical strengths
-
A coherent operator-based construction. Deriving drift and covariance from an estimated generator and its carré du champ provides a clear connection between graph-based manifold learning and continuous SDE simulation. The density-correction parameter also gives an interpretable family of dynamics. This construction is potentially useful for stochastic simulation when the manifold is available only through samples.
-
Evaluation aligned with the dynamical objective. The experiments assess path MMD, quadratic variation, and off-manifold error across sample sizes. These complementary diagnostics examine temporal behavior and geometric fidelity, providing meaningful empirical evidence relevant to the paper’s central goal of approximating entire diffusion processes.
Critical weaknesses
-
The central path-space convergence guarantee is not established by the provided proof. The Taylor comparison in Proposition 3 does not justify transferring strong-resolvent convergence of the graph operator to the interpolated continuous SDE. Appendix C nevertheless uses the graph semigroup to represent IMD expectations in Eq. (69). It also infers convergence from a fixed starting point from semigroup convergence and asserts the uniform increment bound in Eq. (71) without deriving it. These gaps affect Theorem 1, which underpins the paper’s principal theoretical contribution.
-
The real-data experiment does not isolate the benefit of IMDs. The COIL-20 pipeline combines learned viewpoint augmentation, strong endpoint guidance, tangent-plane retraction, and noise tapering (Appendix F.5), but compares only against linear interpolation. Without baselines using the same augmented data and ablations of the added components, the reported improvement cannot be attributed specifically to the proposed diffusion construction. This substantially limits the evidence for its practical advantage on real data.
Questions for authors
-
Clarification of the graph-to-SDE convergence argument. How does the Taylor estimate in Proposition 3 imply semigroup convergence for the continuous IMD after off-sample interpolation? In particular, how is using the graph semigroup for IMD expectations in Eq. (69) justified, given that the continuous process has generator ?
-
Clarification of initial conditions and tightness. What assumptions justify convergence from a fixed starting point from the semigroup limit, and how is the -uniform increment bound in Eq. (71) derived? If additional assumptions are required, are they satisfied by the graph construction and interpolation used in the experiments?
-
Clarification of the COIL-20 evidence. Are matched baselines or ablations available that separate the contribution of IMD dynamics from learned viewpoint augmentation and the additional bridge corrections? Results using the same augmented data and comparable endpoint guidance would materially affect my assessment of the method’s practical contribution.
2 comments
Followup on our rebuttal
Dear Reviewer migQ, thank you again for your time and constructive feedback.
We have addressed your concerns by clarifying and fixing the typos in the proofs, as well as extending our image experiment to include both a ground truth and more suitable baseline, better isolating the capabilities of IMDs. Since the discussion period will soon be coming to an end, we would appreciate it if you could consider our rebuttal and improved manuscript and take these changes into account in your assessment.
We would be happy to respond to any further questions or concerns you may have.
We thank the reviewer for providing insightful feedback, which, upon revision, has greatly improved the clarity and tightness of the manuscript’s theoretical statements and experiments.
We thank the reviewer for this comment. We believe the confusion arises from conflating Theorem 1 and the graph-based estimator in Section 6. Crucially, IMDs are defined through operators, making Prop. 2 an independent, rigorous asymptotic result. Let us now clarify that the purpose of the Taylor expansion was to motivate the finite-N continuous IMD construction. It was not intended to establish semigroup convergence. The latter follows from Prop. 2, which relies on generalized strong-resolvent convergence. We have clarified the intent of Prop. 3, and added a short discussion relating to existing literature, e.g. [2,3] in Appx. B.5.
This question relates to the previous, and arose from a typo in the proof of Theorem 1. Introducing GN was confusing, and led to conflating it with Proposition 3. We reiterate that Theorem 1 is based on a general estimated operator L^N, not on any particular graph Laplacian or semigroup. We have now fixed this typo.
We agree with the reviewer that the viewpoint augmentation did not adequately capture the contribution of IMDs. Prompted by this critique, we have now updated the image dataset experiment of Sec. 7.4 to better highlight the benefit of IMDs by generating a controllable synthetic dataset, thereby removing the augmentation, providing both a ground truth and a baseline (Fig. 6).
In particular, we extended the dataset to 2-dimensional rotations, effectively augmenting the implicit manifold from a circle to a torus. We conducted a comparison of pixel-space IMDs to image-rendered toroidal Brownian motion (ground truth) and a graph-based random walk (baseline). See Figs. 6, 9 and 10 of the updated manuscript. We observe that IMDs reproduce the reference diffusion's path MMD and QV with accuracy comparable to the graph random walk, while generating continuous trajectories in pixel space. This demonstrates that IMDs perform Brownian motion in the high-dimensional space of images of rotated 3D objects (Table 5). This better captures the contribution of IMDs as a method for stochastic dynamics on data manifolds without geometric priors. We also performed kernel-type ablations in Fig. 10. We refer the reviewer to Section 7.4, and Appx. F.5.1 of the updated manuscript for further details.
Thank you for this question. We believe this arises from a typo in the proof of Theorem 1. Specifically, Theorem 1 proves convergence for a sampled starting point and not a fixed starting point. We have corrected this issue.
The increment bound follows from standard results in stochastic analysis, particularly Hölder's inequality and the Burkholder-Davis-Gundy inequality [1]. These allow us to control the increments of the stochastic process using the uniform moment bounds on its drift and diffusion coefficients, which are now explicitly stated before the proof of Theorem 1.
All assumptions required to prove the asymptotic graph-operator limit (Prop. 2) are in Assumption 1 (Appx. B). We emphasize that transferring this convergence to the particular interpolated continuous SDEs used in our experiments requires additional conditions that are typical in established graph-Laplacian consistency and stochastic process approximation results [2,3]. We discuss these in Appx. B.5.
Furthermore, the experiments complement our theory by demonstrating practical effectiveness of our method. We believe this combination of rigorous asymptotic analysis and empirical validation provides a solid foundation for IMDs, with further guarantees for finite-sample dynamics, making for a natural direction for future work.
[1] Revuz and Yor, Continuous martingales and Brownian motion
[2] Guérin, Nguyen and Tran, Strong Uniform Convergence of Laplacians of Random Geometric and Directed kNN Graphs on Compact Manifolds
[3] Ethier and Kurtz, Markov Processes: Characterization and Convergence