- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates an issue that arises when enforcing constraints during the sampling process of flow-matching models. The algorithms used typically estimate the final, noise-free endpoint of the trajectory, modify it to satisfy the desired constraint, and then interpolate the corrected endpoint back to an intermediate state along the sampling trajectory. The authors argue that this procedure introduces non-trivial distortions to the sampling and propose an alternative correction method to address it. The paper provides a detailed theoretical analysis of the problem and the proposed correction step, which it then extensively evaluates on PDE benchmarks, demonstrating improvements when applied on top of the existing algorithms.
Critical strengths
-
The paper investigates an important issue in enforcing constraints during the sampling process of flow-matching models. A large body of work relies on algorithms that estimate the final, noise-free state at each sampling step, apply the desired constraints to this estimate, and then interpolate the corrected state back to an intermediate noisy state along the sampling trajectory. An important question is whether this constraint enforcement and subsequent interpolation can push the intermediate state too far from the trajectory expected by the model, introducing errors that propagate through the following sampling steps and affect the generated samples. The paper provides a theoretical analysis of this issue and proposes an alternative constraint optimization and interpolation procedure to address it. Importantly, the problem is not limited to the PDE inverse problems studied by the authors, but is relevant to a broader range of constrained flow-matching applications, such as generation of images and video.
-
The experimental evaluation is well-executed, covering a range of PDE benchmarks. The proposed MSP correction leads to substantial improvements in most settings, while also reducing performance differences between methods. These results provide strong evidence that the issue the authors have identified has a significant impact on the sampling process and that addressing it is essential for improving constrained sampling with flow-matching algorithms.
Critical weaknesses
-
The Asymptotic Secant–Tangent Consistency (ASTC) assumption, introduced in Definition 1, requires the instantaneous velocity predicted by the model to converge to the secant velocity between the initial noise and the current noisy state. However, it is unclear why this assumption should hold for the base learned flows. In general, flow-matching models do not guarantee to learn straight trajectories (not possible in many cases). Even with a perfectly learned velocity and infinitesimal integration steps, the instantaneous velocity may differ from the average velocity along the trajectory. The authors claim that the ASTC fails after projecting the terminal state prediction onto the constraint manifold, but it is unclear whether the observed inconsistency is introduced by the projection itself or was already present in the underlying learned flow. The authors should clarify under what conditions ASTC holds before projection; does it only hold for straight-line flows, and if so, how often do these appear in the problems they study? Then they should distinguish the effects of the terminal state projection from the effects naturally arising from the non-linear flow trajectories.
-
The authors propose Minimal Step-wise Perturbation (MSP) to fix the issues with existing terminal-projection methods. Rather than projecting the predicted terminal state and interpolating it back to the sampling trajectory, MSP formulates the correction as an optimization problem that minimizes the Euclidean distance between the constrained next state and the unconstrained Euler update. While this guarantees minimal local perturbation, it does not necessarily establish that the corrections are consistent with the desired constrained posterior. Consequently, demonstrating that MSP eliminates the surplus velocity does not necessarily imply that it improves the generated constrained samples under that posterior. This raises an important question of whether MSP provides a more faithful approximation of the true posterior under the constraints, or whether it simply introduces a different local correction rule that improves performance.
Questions for authors
-
Is there a toy setting where you can easily demonstrate the issues with ASTC and projections? I believe that it is important to establish that projection is the root of the discrepancy rather than the nonlinear trajectories already present in the learned flow. A comparison of the ASTC defect before and after projection in a setting with a known velocity field would help clarify this distinction.
-
In Table 2, ProFlow seems to benefit less from MSP than PCFM and ECI. Could this be related to ProFlow resampling the noise at each integration step? Since MSP is originally formulated using a fixed initial state, it would be useful to (empirically) clarify how this affects the stochastic resampling.
-
Something missing from the paper was the additional overhead added by the MSP. I would assume that it is negligible compared to forward passes and the projection step, but could the authors mention it?
Reviewer Mbh7 & Dc2G] Urgent Reminder: Discussion Period Ends November 18
Dear Reviewers Mbh7 & Dc2G,
The discussion period will end on November 18, 2026. Please carefully review the authors' responses and actively engage in discussions.
If you have not yet initiated a discussion, please do so immediately. Reviewers are expected to address the authors' rebuttals, provide constructive follow-up comments, and update their evaluations when appropriate.
Please also ensure that your reviews reflect independent human judgment and that any AI assistance is properly documented in accordance with the review guidelines.
Active participation is an essential reviewer responsibility and is critical to ensuring a rigorous and fair review process.
Thank you for your cooperation.