- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper generalizes the theory of stochastic interpolants to targets whose structure is partly known through a structure map c whose level sets (fibres) partition the state space, for example for systems with constraints or invariant under symmetrries. Transport is disintegrated into a prescribed motion between fibres and a learned motion within fibres (a vertical velocity). The theory is fully developped giving the decomposition of the continuity equation and regression objectives. Experiments cover constrained partial differential equation (PDE) trajectory generation, QM9 molecular geometry with prescribed moments, a synthetic Stiefel target, and a planar chain with symmetry and bond constraints.
Critical strengths
-
A very detailed and techically solid formulation of the problem in terms of measure-theoretic disintegration. This is the right mathematical framework, at the correct level of generality and I found this part of the paper extremely well written and very informative.
-
The implicit construction (Equations 22 to 24 and Appendix C) is practical, with matrix-free projections and structure-specific direct solves. This makes the abstract measure-theoretic framework widely applicable. The theoretical foundation provided by the papers are overall very strong.
Critical weaknesses
- The abstract claims structure is satisfied "substantially better than alternatives", but in Table 2 the conservation error of CFFM equals that of the disintegrated model. Likewise the result in Table 3 seems to be summarized in a rosy manner. From my understanding the results from the paper are roughly comparable with state of the art models.
Questions for authors
-
Can you justify better your claim that your "substantially better than alternatives"?
-
Can you provide a critical analysis of the assumptions in the theory parts. For example the assumption of uniquness in Theorem 2.6. Can one verify the uniqueness by durect arguments in specific setting (say Stielfel or circle case)?
-
The quotient-space diffusion equivalence is proved for planar rotations only. The main application of quotient-space diffusion is the three-dimensional rotation group acting on molecular coordinates, where no smooth global section exists and the orbits are curved. Does the equivalence in the abstract and Section 5 extend to that case, and what is the structure map?
2 comments
I thank the authors for their detailed answers. This is only reinforce my opinion that is a strong theoretical work, and I keep my grade.
We thank the reviewer for their excellent questions, and we are very grateful for a thorough engagement with our work and for highlighting its strengths. We answer the questions below:
In the PDE experiments, DSI achieves better performance than a model with four times as many parameters and is also better than ambient Flow Matching in the QM9 experiments and competitive with the specialized baseline.
But we agree that "substantially better than alternatives" is an overstatement. Our main contribution is a theoretical framework that covers many possible methods, and building better algorithms based on this theory is a future direction. The current results show early evidence that it is possible to develop algorithms based on this theory that will be substantially better than alternatives.
Therefore, we will weaken the claims by changing the following sentence:
“ Across geometric and physics-based problems, our disintegrated models learn target distributions more accurately at matched training budgets and satisfy prescribed structure substantially better than alternatives.”
to
“Across geometric and physics-based problems, our experiments show that disintegrated models can improve distributional accuracy while satisfying prescribed structure.”
Yes, we can. Focusing on the uniqueness assumption in Theorem 2.6, Theorem 1.1.10 in [1] provides a sufficient criterion: for an Itô SDE with locally Lipschitz drift and diffusion coefficients, solutions with the same initial distribution have the same law. For the base schedule Bt(y)=(1−t)y, our sampling equation (20) has the Itô form
d\widehat X_t =b_\theta(t,\widehat X_t)\,dt+\sigma(t,\widehat X_t)\,dW_t, \qquad b_\theta(t,x) =-\frac{H_xc(x)}{1-t} +\widehat u_t(x)+\varepsilon_t\widehat s_t(x) +\varepsilon_t\mathcal H(x),\\ \sigma(t,x)&=\sqrt{2\varepsilon_t}\,P_x, \end{aligned}$$ where $\mathcal H=\sum_jD(Pe_j)[Pe_j]$ is the curvature correction. We can apply Hsu’s theorem to the augmented state $(t,X_t)$. It is sufficient that the coefficients are locally Lipschitz jointly in $(t,x)$. Since sums and products of locally Lipschitz functions are locally Lipschitz, sufficient conditions on every $[0,T], T<1$, are: - **Constraint:** $c \in C^3$, with full-rank Jacobian on an open set U, and the scheduled fibres through each regular initial state remain in a compact subset of U. Then $H,P$ and $\mathcal H\in C^1$, making both the curvature term and the prescribed drift locally Lipschitz. - **Network outputs:** The velocity and score/noise networks are locally Lipschitz jointly in $(t,x)$. Projection by $P_x$ preserves this property. - **Noise schedule:** The sampling amplitude $\sqrt{2\varepsilon_t}$ is locally Lipschitz in time. For the **circle**, $c(x)=\|x\|-1$ is smooth with nonzero gradient on $U=\mathbb R^2\setminus\{0\}$. The prescribed radius satisfies $$r_t=(1-t)r_0+t \in[\min(r_0,1),\max(r_0,1)].$$ Thus, for $r_0>0$ the condition on the constraint function is satisfied. For **Stiefel**, $c(X)=X^\top X-I$ is smooth with a full-rank Jacobian whenever X has full column rank. Starting from $G_0 \succ 0$, the prescribed evolution $$G_t=X_t^\top X_t=(1-t)G_0+tI$$ keeps matrices bounded and away from rank deficiency, verifying the constraint condition. These, together with the stated network and schedule assumptions, establish the assumptions for Theorem 2.6. > The quotient-space diffusion equivalence is proved for planar rotations only Thank you for raising this point! It's actually an important but subtle technical point which we would like to clarify. Yes, the equivalence extends to SO(3) actions but with a slight change to what is presented in the main text. The problematic part in the main text is that in our formulation the vertical subspaces always come from the kernel of the structure map $c$. The regularity properties of the structure map make Dc integrable, whereas the directions orthogonal to rotation orbits need not be. Allowing projectors that do not arise from a structure map preserves all the theorems related to the prescribed/learned decomposition and extends the transport, training and sampling constructions, recovering QSD under its assumptions without requiring a global section. However, presenting this more general formulation adds abstraction and complexity unnecessary for our focus on constraints, so we have rewritten Appendix E.1 to explain this generalization, and will qualify the equivalence claims in the abstract and Section 5 accordingly. 1. Hsu, E. P. (2002). Stochastic Analysis on Manifolds. Graduate Studies in Mathematics, Vol. 38. American Mathematical Society