- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Constraint-Aware Flow Matching (CAFM), which adapts flow matching training to constrained sampling by computing a reconstruction loss after projecting the predicted clean endpoint onto the constraint set. An instantaneous endpoint estimate avoids differentiating through the full ODE trajectory, while a differentiable projection layer propagates the training gradient. Inference uses the PCFM sampler. Experiments cover constrained PDEs, wind fields and porosity-constrained microstructures.
Critical strengths
-
The comparison with PCFM shows useful gains with the same sampler. Burgers-IC standard-deviation MSE (SMSE) falls from 0.101 to 0.0575 while preserving feasibility, and wind coherence violation decreases by more than an order of magnitude. This suggests a practical benefit from training for the constrained sampler.
-
The ablations provide relevant evidence about the training choices. Appendix E shows that the Burgers-IC SMSE gain persists without additional ReFlow and that full ODE rollout offers no consistent advantage over the instantaneous endpoint estimate. Figure 3 also compares continued FM training with transitions to CAFM, supporting the use of pretrained models for adaptation.
Critical weaknesses
-
The methodological contribution is narrower than the paper claims. Chen et al. [1] already train a biomolecular diffusion model with losses computed on projected denoiser outputs, differentiate implicitly through the projection, and compare fine-tuning against inference-only projection. CAFM extends this principle to flow matching and different scientific constraint settings, which is useful, but the “first end-to-end training approach” claim should be qualified. Given this overlap, I view the main contribution as an empirical extension, whose value depends on the evidence for better constrained generation.
-
The sampler that CAFM is trained for is not, in general, consistent with the learned flow. The reverse update in Section 4 re-interpolates between the initial noise and the projected endpoint, which follows the ODE trajectory only when the learned paths are straight. With an independent coupling, each conditional path is straight but the marginal trajectories are not, and the justification in PCFM [2] seems to assume straight trajectories. Since the CAFM objective trains the projected endpoint prediction but not this update, I am not sure that the claimed alignment of training and sampling extends to the generated distribution. Part of the quality loss attributed to training-free projection may also come from the re-interpolation itself.
-
The evidence for improved sample fidelity is incomplete, particularly for microstructures. Appendix B.3 measures each image’s MSE against a fixed mean image, so reducing sample variation can improve the score. Nearest-training-image MSE also does not measure coverage. Without generated examples or structural statistics, I cannot tell whether CAFM produces a better distribution of plausible microstructures. For PDEs, pointwise means and standard deviations are informative, but leave joint space-time structure untested, and no generated samples are shown for any of the tasks.
-
Some conclusions go further than the results. Section 6.1 states that CAFM consistently improves accuracy and feasibility, yet Burgers-BC SMSE worsens from 0.000460 to 0.00105, and PDE feasibility is already at numerical precision for both CAFM and PCFM. On wind, the large coherence gain comes with a higher variance MSE (0.417 to 0.473), which the authors acknowledge. I think the claims should be limited to the metrics where the gains are clear.
[1] Chen et al., “Physically Valid Biomolecular Interaction Modeling with Gauss-Seidel Projection”, ICLR 2026.
[2] Utkarsh et al., “Physics-Constrained Flow Matching: Sampling Generative Models with Hard Constraints”, NeurIPS 2025.
Questions for authors
-
Under what conditions on the learned flow, for example straighter paths after ReFlow, does the combined procedure target the data distribution? It would also help to compare the sampler with the projection disabled against plain ODE sampling of the same model.
-
On Burgers-IC, the PCFM results in Table 1 are much weaker than those reported in [2] under what appears to be the same setup. Could you explain the difference, and does CAFM still improve on PCFM when PCFM is configured as in [2]?
-
Section 5.2 presents Eq. (10), the 1-RF variant in Appendix E, as the method, but the Burgers-BC results in Table 1 match the 2-RF variant in Table 3. Could you state which variant was used for each task? Since 2-RF is trained on endpoints from a frozen PCFM teacher, part of its gain may come from these samples rather than from the projected loss. Is the continued-FM curve in Figure 3 also evaluated with the PCFM sampler?
6 comments
W3: The evidence for improved sample fidelity is incomplete, joint space-time structure untested, and no generated samples are shown for any of the tasks.
Thank you for highlighting the importance of distributional evaluation. Our PDE experiments include both MMSE and SMSE, assessing agreement with the reference mean and standard-deviation fields. These metrics have follow prior evaluations for this class of constrained generative modeling tasks [1,2,3]. However, during this period, we extended this evaluation with joint space-time statistics and distributional comparisons under matching constraint specifications.
| Task | Metric | PCFM | CAFM (1-RF) | CAFM (2-RF) |
|---|---|---|---|---|
| Burgers-IC | SWD | 0.4146 | 0.3542 | 0.2957 |
| RMS ratio; target = 1 | 2.723 | 2.400 | 1.782 | |
| Burgers-BC | SWD | 0.0686 | 0.0887 | 0.0509 |
| RMS ratio; target = 1 | 0.992 | 0.985 | 0.922 |
The reduction in sliced Wasserstein distance indicates closer agreement between the generated and reference solution distributions beyond pointwise statistics. The RMS ratio complements this comparison by assessing whether generated samples exhibit a similar overall level of variability to the training distribution.
We also updated the appendix with generated examples to assist in interpretation of the results (Figure 3).
For microstructures, the prescribed porosity changes the generation target relative to the training distribution. Evaluating constraint satisfaction and nearest training sample MSE assesses adherence to the requested design property while retaining proximity to observed microstructures. These metrics provide evidence relevant to inverse design, although they do not fully characterize coverage of the constrained target distribution, for which a matched reference ensemble is not directly available. In other words, the training data does not satisfy the inverse design constraints, so metrics for training distribution coverage are not directly applicable here.
W4: Some conclusions go further than the results.
We would like to clarify the intended meaning of accuracy in this statement. Appendix B.1 defines MMSE as evaluating "how accurately the model reproduces the expected or average behavior of the target distribution." CAFM improves this metric over PCFM across all three PDE benchmarks, supporting the stated improvement in accuracy. SMSE is a secondary metric measuring standard deviation, and we acknowledge that improvements in mean-field accuracy do not imply uniform improvements in uncertainty statistics.
The feasibility results depend on the setting. We agree that both CAFM and PCFM achieve numerical-precision constraint satisfaction on the PDE benchmarks, where the appropriate conclusion is improved mean-field accuracy while preserving feasibility. In wind modeling, CAFM improves both mean-field accuracy and achieved feasibility: coherence violation decreases from to , approximately , under the same sampling-time projection setup. This gain accompanies the variance-MSE tradeoff already acknowledged in Section 6.2. However, to improve clarity, we have adjusted the wording to avoid overstating the empirical improvement realized by CAFM.
Q2: On Burgers-IC, the PCFM results in Table 1 are much weaker than those reported in [2] under what appears to be the same setup.
The PCFM results reported in Table 1 follow the exact setup used in the officially released code base. Indeed, we flagged this discrepancy between our reproduced numbers and the reported PCFM numbers and reached out to the authors regarding this; we have not recieved any response to our request for additional details on the setup used to achieve their reported numbers. Our reported comparison therefore uses our reproduced PCFM baseline under the shared evaluation setup.
Q3: Could you state which variant was used for each task?
Thank you for identifying this ambiguity. We are happy to clarify!
Equation (10) defines the projected-endpoint objective used by both 1-RF and 2-RF. Thus, we frame the method as general to both cases. We use ReFlow selectively in the PDE setting (Burgers-BC) where it improved performance, rather than as a requirement for CAFM. Wind and microstructure experiments use the objective without additional ReFlow. We have added these details to Appendix B.
We agree that teacher-generated pairs may contribute to the performance of the 2-RF variant. Appendix E also evaluates CAFM without additional recoupling, showing that useful improvements can be obtained without it. For example, Burgers-BC 1-RF improves both MMSE and SMSE relative to the reported PCFM baseline.
Finally, in Figure 3, all evaluations use the PCFM sampler, so the comparison holds the sampling procedure fixed while changing the training objective. We have made this explicit in the caption.
[2/3]
Thank you, again, for your insightful feedback on our work. We hope that these responses have helped address your remaining concerns surrounding the paper, but we are happy to continue the discussion throughout the response period if there are any remaining questions!
[1] Utkarsh, Utkarsh, et al. "Physics-constrained flow matching: Sampling generative models with hard constraints." Advances in Neural Information Processing Systems 38 (2026): 160217-160252.
[2] Cheng, Chaoran, et al. "Gradient-free generation for hard-constrained systems." International Conference on Learning Representations. Vol. 2025. 2025.
[3] Zhang, Yi, Peng Wang, and Difan Zou. "Physics-informed distillation of diffusion models for pde-constrained generation." arXiv preprint arXiv:2505.22391 (2025).
[3/3]
Many thanks to the reviewer for their careful consideration and detailed review of our paper. In particular, we are appreciative of the reviewer's acknowledgment of our strong empirical results, and their mention of relevant ablations. We have revised the manuscript accordingly, with changes highlighted in red, and address your points below.
Thank you for calling this work to our attention. We agree that their work provides precedent for differentiating through projected end points, and we have adjusted claims such as "first end-to-end training approach" accordingly. However, we would like to clarify the methodological contributions of CAFM beyond extending this principle to additional scientific applications.
Chen et al. apply a differentiable projection to coordinates predicted by a diffusion denoiser and compute the training loss on the projected coordinates. CAFM instead formulates the downstream objective through the endpoint obtained by integrating a learned velocity field (Section 5.1). Evaluating and differentiating this projected endpoint requires an ODE rollout, introducing a computational challenge specific to this formulation. Section 5.2 develops an efficient approximation using the instantaneous velocity, and Appendix E evaluates this approximation against full-rollout training and additional ReFlow.
As discussed through our connection to decision-focused learning, differentiable optimization layers are well established; we do not claim these layers themselves as a contribution. Chen et al. are relevant prior work demonstrating their use in generative modeling. However, CAFM’s methodological contribution lies in formulating projection-aware training through the endpoint of continuous flow dynamics and developing and evaluating a practical approximation to that objective. We have revised the related-work discussion and contribution statements to make this distinction explicit.
We acknowledge the distinction drawn between the learned ODE trajectory and the re-interpolation update. Our experiments adopt the existing PCFM sampling implementation, with our contributions targeting adjustments to the training objective.
While we agree that straight conditional training paths do not guarantee straight marginal trajectories, it is worth clarifying:
Improving the sampler is outside the scope of the paper. CAFM explicitly incorporates the projected endpoint prediction into training. Our claim of alignment concerns this correction; it does not establish that the complete re-interpolation procedure reproduces the learned ODE trajectory. The PCFM comparison holds the sampling procedure fixed and assesses the benefit of changing training within that procedure.
ReFlow ablations are informative. Appendix E measures agreement between the instantaneous endpoint prediction and the endpoint obtained by integrating the learned dynamics. Their close agreement provides empirical support for approximately straight trajectories in the tested settings, supporting the approximation underlying the sampler.
We are also actively running the requested ablation for the PCFM sampler with the projection disabled, and we will follow-up in the thread as soon as we have completed this experiment.
[1/3]