- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CompFlow, a training-free framework for multi-conditional generation by composing conditional velocity fields in flow matching models. The method combines conditional velocity residuals in a classifier-free guidance manner and provides a theoretical analysis connecting velocity composition with a Product-of-Experts formulation. The paper further introduces a composition defect metric to characterize the mismatch between composed velocity fields and the desired probability path. Experiments on CLEVR and FLUX demonstrate the effectiveness of the proposed approach for compositional generation and concept manipulation.
Critical strengths
The paper provides an interesting theoretical analysis of composing conditional velocity fields in flow matching models. Extending compositional guidance from diffusion score models to velocity fields is a meaningful direction.
Critical weaknesses
- The novelty compared with existing compositional diffusion methods is not sufficiently clear. Weighted residual composition is closely related to classifier-free guidance and score composition, and it remains unclear whether the proposed composition defect captures a unique limitation of flow matching or a more general issue of compositional guidance.
- The practical value of the proposed composition defect is unclear. Although it provides a theoretical characterization of conditional interactions, it is not demonstrated whether it can effectively predict failures or improve the sampling process.
Questions for authors
- How is the proposed composition defect fundamentally different from the interaction issues already present in existing compositional diffusion methods?
- Can the authors demonstrate whether the composition defect can be used to guide adaptive weighting or improve compositional generation quality?
4 comments
W2 / Q2. Practical value of the defect: predicting failures and improving sampling.
We thank the Reviewer for this question, which motivated the main additions to the revised manuscript. We answer its two parts separately.
Improving the sampling process. Yes. Cor. 2.6 identifies as the importance weight of the PoE target with respect to the sampler. This gives a defect correction at no additional network evaluation per trajectory: draw samples and keep one with probability proportional to . We tested it on mixtures where every field and density is available in closed form, and report the energy distance to exact samples from the PoE target (lower is better):
| Setting | (uncorrected) | |||
|---|---|---|---|---|
| Interacting concepts | 0.019 | 0.006 | 0.002 | |
| Subtraction | 0.013 | 0.0003 | 0.0000 | |
| Guidance-like weights | 0.153 | 0.122 | 0.073 |
The correction reduces the error monotonically in , also with signed weights, and the gain persists with the practical sampler (Euler 20 steps). In the same setting, the identity of Cor. 2.6 matches the reference KL to four digits (Tab. 15), and the bound of Obs. 2.7 holds in every configuration with the predicted second-order scaling. Both validations are in the new App. D; the resampling results are reported here.
Regarding adaptive weighting, is the exact correction that any adaptive scheme on the weights would have to approximate, and the Gram form of Eq. 12 indicates where such a scheme should act: on the pairs of concepts with large . We consider this a promising direction, and the conclusion of the manuscript points to it, but it is a separate line of research, beyond the scope of this work.
Predicting failures. On the trained CLEVR model, the defect behaves as the theory predicts (App. B.3):
- It is localized: the cross term concentrates on the pixels where two objects compete (Figs. 3 and 12).
- It follows the interaction: it falls by a factor of 7.2 as the two objects separate (Tab. 8).
- It is positively associated with scene failure at all three detection tolerances, with confidence intervals that exclude zero (Tab. 9). The effect is moderate, since the defect measures the distance from the PoE target, whereas the detector measures whether the requested objects appear.
- The failure modes of App. B.2 (merged, stacked or color-bleeding objects) occur in the regime where Cor. 2.5 predicts the largest cross term: co-located or conflicting conditions.
We hope these clarifications and revisions address the Reviewer's concerns, and we would be grateful if they would consider reassessing their evaluation and score based on the updated text and the above comments, and support the acceptance of the work.
Thank you for the authors' response. It has partially addressed my novelty concerns. However, from my perspective, the practical significance of the Composition Defect remains limited, as its contribution is primarily theoretical and its practical benefits are not sufficiently demonstrated. Therefore, I will maintain my original score.
We thank the Reviewer for the reply, and for acknowledging that our response partially addressed the novelty concerns. We would like to clarify the role of the composition defect.
The paper does not aim to correct the defect. It shows that a single uncorrected ODE composes successfully with the defect present, and explains why. Prior compositional samplers remove this inexactness at extra cost (MCMC correctors, SMC over particles, rejection sampling); our results show this cost is not needed:
-
Its effect is bounded. The sampler error is second order in the interference between concepts, (Obs. 2.7), and vanishes exactly when the defect is constant in space (Cor. 2.5).
-
Composition succeeds. With no corrector, CompFlow is competitive with correction-based samplers on CLEVR (Table 1), and on the subtraction benchmark it removes the concept while keeping the subject in 62% of the images, against 1% for in-prompt negation at matched compute.
As today is the last day of the discussion period, we would be glad to address any remaining concern on novelty, and we would be grateful if the Reviewer would reconsider the score in light of this clarification.
We thank the Reviewer for their thoughtful comments and constructive feedback. We appreciate their recognition that the paper provides an interesting theoretical analysis of composing conditional velocity fields, that extending compositional guidance from score models to velocity fields is a meaningful direction, and that the presentation is clear and easy to follow. We address their concerns below and hope these clarifications will help improve their assessment towards acceptance.
W1 / Q1. Novelty, and how the defect differs from the interaction issues of compositional diffusion.
We thank the Reviewer for the opportunity to state our contribution more sharply. The focus of our work is a single question: what can a single flow-matching ODE do? That is, how far composition goes with one deterministic trajectory, no corrector, no resampling, no SDE, and only the m+1 network evaluations needed to evaluate the composed field. This question is the novelty of the paper, and everything in it (the algebra, the defect, the experiments) is an answer to it.
We are aware and agree with the Reviewer that, under Gaussian paths, weighted residual composition is related to classifier-free guidance and to score composition, and the original manuscript stated this (lines 45–47). Our contributions are the following.
1. An algebra of concepts for flow matching. We show that a single rule in velocity space composes an arbitrary number of conditions with signed weights: positive weights add concepts, negative weights subtract them, and the result is one ODE of a pretrained model, with no training and no architectural change (Prop. 2.2 and Cor. 2.3). To the best of our knowledge, the flow-matching literature has no such algebra: we are not aware of any work that composes an arbitrary number of conditions, with addition and subtraction, on flow-matching models.
2. A single ODE is enough in practice. Existing compositional diffusion methods treat the inexactness of plain composition as something to repair in the sampler: Du et al. (2023) add MCMC steps, and Skreta et al. (2025) reweight and resample populations of SDE particles. We take the opposite route and show that the correction-free ODE is already competitive. We kindly invite the Reviewer to consider this empirical evidence, which we regard as the core of the paper:
3. An exact account of what the single ODE does. This is where the composition defect differs from the interaction issues known in compositional diffusion (Q1). Those works observe that summed scores are not the score of the product, and add a corrector. The defect instead characterizes the sampler that has no corrector: Prop. 2.4 gives its residual in closed form, for any number of concepts and for signed weights, using only quantities available at inference time. It states when no correction is needed, namely if and only if Dt is constant in space, which holds under conditional independence (Cor. 2.5). It also separates two sources of error (Eq. 12): a self term, which recovers the known inexactness of classifier-free guidance away from unit weight, and a cross term λiλj⟨δi,δj⟩, which is the interaction between distinct concepts and can be localized in the image (Figs. 3 and 12).
New results. To make this account complete, the revised manuscript adds two results (new Cor. 2.6 and Obs. 2.7, proofs in App. A.5). The defect integrated along a trajectory,
L=∫01tσtDt(Xt)dt,
is exactly the log density ratio between the PoE target p~1 and the law q1 of the sampler, up to a constant:
\qquad \mathrm{KL}(q_1\,\Vert\,\tilde p_1)=\log\mathbb E\big[e^{L}\big]-\mathbb E[L]\le\tfrac18\big(\sup L-\inf L\big)^2 .$$ The single ODE therefore reports its own distance from the target, with no additional network evaluation, and this distance is bounded by the interference between concepts: weakly interfering concepts give a nearly exact sampler. To the best of our knowledge, these results have not been studied for flow-matching ODEs. We validated both on closed-form mixtures (new App. D).