- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper asks whether properties of the paths used to train flow matching also hold for the trajectories the model actually generates. It shows that exact population matching preserves the distribution at each time and expected integrated state costs, while trajectory properties such as hitting probabilities and endpoint pairing can change. It also studies when integrated costs can bound endpoint violations, with experiments on tori, rotations, and molecular reconstruction.
Overall, I feel this is a careful analysis paper with a useful message, but the contribution feels somewhat incremental.
Critical strengths
The distinction between conditional paths, the population flow, and the fitted generator is useful. The circle example is particularly clear: it shows that trajectory statistics can change even with perfect regression and exact integration. I appreciated the separate pairing and path-design controls, the ten-seed evaluations, and the confirmatory entry-probability study with new seeds and multiple-testing correction. The paper also avoids treating lower path cost as automatic evidence of better endpoint fidelity.
Critical weaknesses
I’m not fully convinced by how much new insight is added beyond existing flow-matching theory. Rectified Flow already explicitly discusses preserving time marginals while changing the joint distribution of trajectories and the endpoint coupling. The circle counterexample and validity analysis are useful additions, but I would like a clearer explanation of what they teach us beyond that established distinction.
The learned-model results are harder to interpret than the analytic example. As the authors acknowledge, differences between training and generated trajectories can also come from fitting error. However, the capacity study in paper only tracks integrated cost, rather than the path-event differences. This leaves me unsure how much of the observed difference in trained models is actually caused by marginalization, which is central to the paper’s motivation.
Questions for authors
In Section 3.1, what is the main new conclusion about validity beyond the known distinction between matching time marginals and matching full trajectories? The circle example makes this distinction clear, but I would like to understand which existing assumptions or claims about flow matching it changes.
In Section 4.1, GAOC-FM (OT) reduces the accumulated state penalty along generated paths compared with OT-RFM. Does this mean fewer paths enter high-cost regions, or that they spend less time there or encounter smaller penalties? Could you clarify whether the lower cost also translates into fewer generated trajectories violating the validity criterion?
4 comments
Response to Reviewer ReX8 (2/2): novelty relative to Rectified Flow
Novelty relative to Rectified Flow. You note that Rectified Flow already separates preserving time marginals from changing the trajectory law and the endpoint coupling, and ask what the circle example and the validity analysis of §3.1 add, and which assumption or claim about flow matching they change.
We agree that marginal preservation and the change of endpoint coupling are established in Rectified Flow. The revision also credits the length and kinetic-energy inequalities to the rectification and interpolant literature and to conditional Jensen. What we add is the transfer distinction below and the controlled attribution experiment in part 1 of this response.
The hitting distinction can be stated with a fixed hazard. The construction is new and analytical, separate from the trained experiments that follow it.
Proposition. There are two endpoint-pinned shortest-geodesic teacher families on with the same one-time marginals, expected length, kinetic energy and teacher hitting rate for the same hazard, whose population flows have different hitting rates. For continuous teacher and population paths with equal one-time marginals, almost-sure avoidance of any open set transfers in both directions.
Construction and proof. Set , let be uniform on , and fix . Define , with independent of . In family , is or with equal probability; in family , is with probability and with probability each. The endpoint pair determines , and every nonconstant arc is a shortest geodesic.
In both families is uniform for every , and . The complement of has width , so every moving teacher that starts outside enters , and every stationary one stays outside: both conditional teacher entry rates are . Given any current state, keeps its original law, so the population angular velocities are and , with conditional entry rates and . Counting starts inside , the hitting probabilities are
Hitting can thus move in either direction with the hazard and these teacher summaries fixed; what differs is the endpoint coupling.
For avoidance, a continuous path that enters an open set spends positive time in it. Equal one-time marginals give equal expected occupation by Tonelli, so one law enters with probability zero if and only if the other does. This concerns continuous population paths, not fitted fields, sampled nodes or contact with a closed boundary.
Trained experiments. On the area-uniform annulus , the three arc families we trained have known rotational population fields. Conditional entry rates over ten seeds with 16,384 starts per seed (the exact column is analytical):
| Conditional turns | Hazard width | Teacher estimate | Exact population entry | Student estimate |
|---|---|---|---|---|
| or , equal weights | 0.502 | 0.750 | 0.744 | |
| or , equal weights | 0.502 | 0.641 | ||
| , equal weights | 0.501 | 0 | 0.001 |
All three primary student–teacher contrasts have , so trained generators follow the predicted direction in both cases. The hazard differs across rows, and itself has not been trained. The first family turns by , so its arcs are not shortest geodesics.
The registered avoidance diagnostic uses the smaller open disc , which neither teachers nor the population flow enter; the largest student rate into that disc over seeds is 0.23%.
Which inference changes? Teacher hitting rate, marginals and length together do not determine the generator's hitting rate, whereas zero entry into an open set is guaranteed at the population level. Hitting therefore has to be measured on generated trajectories. Claims about marginals in earlier path-design work are unaffected, and the avoidance argument itself is elementary.
Do this distinction and the attribution in part 1 resolve your concerns about novelty and attribution? If so, we would be grateful if you would reconsider your assessment; if not, we would like to know which objection remains.
Thank you for the response and I feel most of my concerns are addressed. Though I still think theoretical contribution is rather modest, the added construction and attribution experiments makes the paper more clear and convincing. I saw authors haven't incorporate the changes in revision, please add them and I'll raise my rating to 3 after that.
Response to Reviewer ReX8 about changes in the revised PDF
Thank you for the follow-up. As you asked, the construction and the attribution experiment are now in the revised PDF.
- The fixed hazard construction and avoidance of open sets are Proposition 1(b) and (c) in §3.1 (p. 4), proved in Appendix C.2 (p. 18). Table 1 (p. 5) is split to match, and §3.1 credits rectified flow and stochastic interpolants for marginal preservation and the change of coupling.
- The attribution experiment (our Table R3) is §4.2 and Table 3 (p. 8). Appendix H (p. 31) has all 16 tests, the sensitivity to sample size and bandwidth, the validity checks and the caveat.
- Your question on what lower cost means is answered in Appendix F. Table 12 (p. 26) compares occupation with terminal violation, and Table 13 (p. 27) reports joint entry.
Two further points. Table 3 gives wide ridge teacher entry 0.0288, while the confirmatory Table 17 (previously Table 9) gives 0.024 for the same seeds. Table 17 uses the 1,024 stored evaluation pairs per seed, and the oracle protocol adds 15,360 fresh pairs from the same coupling. On the stored pairs alone, the oracle runs reproduce Table 17 exactly (teacher 0.024, student 0.005). Student entry is below teacher entry on both sets, by 0.019 and 0.024. The Table 3 caption and Appendix H state this.
We also trained the second family of Proposition 1(b) at the same hazard (Appendix I, Table 21, p. 33). Both teachers enter at 0.502, and the students enter at 0.641 and 0.003, against the predicted 9/14 and 0 (paired , ten seeds). Our earlier caveat that was untrained no longer applies.
Thank you again for the careful review.
Response to Reviewer ReX8 (1/2): attribution
Thank you. Our response comes in two parts because of the comment length limit. This part covers attribution and the meaning of lower cost; part 2 below covers novelty relative to Rectified Flow.
You are right that the capacity plot in the PDF cannot attribute the hitting gap. For this response we measured the population field separately from the fitted student on the primary T2 tasks.
The oracle estimates density and velocity flux from 1.6×107 teacher paths per seed, with the training OT block size of 256, and integrates their ratio without fitting a student network. OT-RFM has no teacher network either; for GAOC-FM (OT) the learned teacher is frozen.
In the infinite-sample limit, Gaussian smoothing with bandwidth h gives the population field of the teacher family with a static offset. The implemented oracle adds sampling, grid and integration error, so we compare it with the equally offset teacher and apply the declared marginal, fidelity and stability checks.
Write J=teacherh−teacher, Δpop=oracleh−teacherh and Δres=student−oracleh, so that the observed gap is exactly J+Δpop+Δres. Here Δres contains finite fitting together with any remaining oracle and numerical error.
Table R3. Seeds 10–19, 16,384 evaluation paths per seed; entry conditional on starting below τ=1; marginal 95% seed-bootstrap intervals.
The teacher column is unshifted; the offset used in Δpop changes mean entry by at most 0.0006. All eight Δpop tests (τ=0.5 and 1) have pHolm=0.031 in the declared family of 16 tests, and at τ=1 the student lies between the oracle and the teacher. On the primary T2 tasks, marginalization is therefore the dominant source of the reduction, and the student residual works against it.
Every primary T2 cell passes the declared checks on integrated cost, endpoint W2, and stability in sample size and bandwidth, and the basins null check is zero. In an exploratory check against the numerically integrated closed-form T2 RFM field, the kernel estimate of Δpop differs by at most 0.0022 in the seed mean and 0.0054 for a single seed. These are finite-resolution checks.
The exploratory T8 Monte Carlo field raises low effective-sample-size flags and fails the originally tabulated fidelity check. A later matched-sample-size comparison is reassuring, but the flags stand, and we do not use T8 for attribution. The limitations section will say that attribution is established for the validated T2 tasks.
On the T2 ridges, occupation of the high-cost region falls sharply while terminal violation does not, and the change comes from paths that start inside the region. The existing ten-seed E1 panel (descriptive) separates the two. At τ=0.25 on the wide ridge, moving from OT-RFM to GAOC-FM (OT) lowers mean occupation from 0.2409 to 0.0684, while terminal violation is 0.0409 against 0.0397. On the narrow ridge, occupation goes from 0.0532 to 0.0136 and terminal violation is 0.0027 for both. In the exploratory transfer records, no path enters the τ=0.25 region on either ridge at the scoring resolution.
On T8, the joint probability of starting below τ=1 and later entering falls from 0.221 to 0.133 (unadjusted p=0.002). This is a joint probability, unlike the conditional entry in Table R3. Integrated cost alone cannot separate these mechanisms.