- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper uses a trained score-based diffusion model to locate the low-dimensional constraint set (manifold) that the training data lies on. Under the manifold hypothesis, prior work shows that a score perturbation approaches the projection onto this manifold The authors build a new method, which they call SCoREMaP, based on this. This method also allows for uncertainty computations as well. The main contributions are theoretical support for the SCoREMaP algorithm, the ability to use a Laplace approximation to get uncertainty maps in the ambient space, and experiments that demonstrate it beating unlearned baselines.
Critical strengths
The method is simple and computationally cheap with a pretrained score model as the primary primitive. The most expensive piece of the method is the score evaluation. Because it operates directly on the learned score field without requiring explicit physical equations, it is potentially applicable across a broad range of scientific domains.
The experiments demonstrate substantial improvements over all tested unlearned baselines. These gains hold across multiple problems and random seeds, suggesting that the learned score field captures constraint geometry more effectively than conventional methods. On molecular tasks, the method also remains competitive with baselines that explicitly incorporate rotational symmetry.
Critical weaknesses
First, the theoretical novelty of the method seems limited. The central residual used follows naturally from the connection between denoising and manifold approximation in the work of Permenter and Yuan (2024). The main theorem is mainly an application of a triangle inequality argument under stringent assumptions. Therefore, I don't know that this work adds much to the theoretical literature around score-based models or manifold learning.
The title is misleading, and the framing is overstated. The method does not appear to extract physical laws or governing equations, and rather is just another manifold learning algorithm. Therefore, the contribution of the work to the literature is much less practical than if it were more tailored and focused on the recovery of specific physical laws.
Questions for authors
Why don't the authors compare to other learned baselines? I feel that they should actually position this work in relation to the broadest possible literature. Could the authors compare SCoREMaP against learned alternatives to establish whether its gains arise specifically from the score-based formulation rather than from learning a flexible representation of the data geometry?
Could the authors comment more on the theoretical novelty - what in particular was developed here that is new and will have broader impacts?