- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
The paper investigates whether CFG-like transformations of the source distribution can replace per-step classifier-free guidance during Flow Matching inference. Specifically, it proposes P-Guide, which extrapolates the conditional and unconditional means of a learned Gaussian prior to enable single-pass inference. Experiments on ImageNet and CIFAR-10 demonstrate improvements in generation quality with reduced inference costs.
Critical strengths
The paper presents a meaningful modeling perspective by shifting conventional per-step classifier-free guidance from velocity-space extrapolation to source-distribution-level guidance. This approach aims to reduce the computational overhead of CFG by requiring only a single backbone evaluation per sampling step. The research problem is well-motivated and practically relevant, particularly for improving the inference efficiency of Flow Matching models.
Critical weaknesses
- Limited effectiveness and unclear benefits of CFG-inspired extrapolation.
Although P-Guide achieves certain improvements in generation quality, these gains are primarily observed when the guidance scale is close to 1, while stronger extrapolation leads to significant performance degradation. This raises concerns about the effectiveness of the proposed CFG-inspired linear extrapolation. In particular, existing methods have already explored learning transformations of the source distribution, and P-Guide appears to reformulate such transformations by introducing a residual term controlled by the guidance scale. Given that the method is only effective under relatively small extrapolations, it remains unclear whether the observed improvements arise from a meaningful CFG-like guidance mechanism or simply from a residual adjustment to the learned source distribution.
- Insufficient theoretical justification for the connection to conventional CFG.
Although the paper establishes a local first-order relationship between source-space perturbations and trajectory-level guidance, it does not sufficiently justify why extrapolating the learned conditional and unconditional source means should approximate the effect of conventional CFG. In particular, exponential tilting of the source distribution does not necessarily correspond to the desired tilting of the generated data distribution. The theoretical analysis identifies an alignment condition, but the proposed prior-learning objective does not explicitly enforce it. Further theoretical or empirical evidence would help establish the connection between the proposed source-space extrapolation and conventional CFG.
- Insufficient comparisons with existing source-distribution modification methods.
Several previous works, such as CAR-Flow, CSFM, and NoiseRefine, have explored improving generation by modifying or learning the source distribution. However, the experiments primarily compare P-Guide against standard CFM and CFG, without providing direct comparisons with representative source-modification methods under unified settings. Since the proposed approach is closely related to these methods, such comparisons are important for establishing the effectiveness and distinct contribution of the proposed extrapolation strategy.
Questions for authors
-
Could the authors provide further theoretical justification or empirical evidence demonstrating that the observed improvements specifically arise from the proposed CFG-inspired linear extrapolation, rather than simply from introducing a residual parameterization of the source-distribution transformation? In particular, it remains unclear whether the conditional–unconditional mean difference provides a unique advantage over other source-space perturbations.
-
Could the authors include comparisons with existing source-distribution transformation methods, such as CAR-Flow or CSFM, under comparable experimental settings? Such comparisons would help clarify the necessity and effectiveness of the proposed extrapolation mechanism beyond existing learned-source approaches.
7 comments
W2
Thank you for this question. Mean extrapolation at fixed conditional covariance exactly reweights the source density, and the same conditional flow transfers that reweighting to the output. The derivation below specifies its connection to conditional–marginal data tilting and to velocity CFG.
Write , , and . For fixed positive-definite conditional covariance , define
\bar{q}_u^{\\,y}=\mathcal{N}(m_u,\Sigma_y),\quad q_w=\mathcal{N}(m_u+wd,\Sigma_y).$$ The reference $\bar{q}_u^{\\,y}$ uses the null-condition mean and conditional covariance, matching mean-only guidance. Expanding the Gaussian log densities gives $$q_w=Z_w^{-1}q_y^w(\bar{q}_u^{\\,y})^{1-w},\qquad \nabla\log q_w=w\nabla\log q_y+(1-w)\nabla\log\bar{q}_u^{\\,y}.$$ For the same invertible conditional flow $\Phi_y$, let $$p_y=(\Phi_y)_{\\#}q_y,\quad r_u^y=(\Phi_y)_{\\#}\bar{q}_u^{\\,y},\quad p_w=(\Phi_y)_{\\#}q_w.$$ The change-of-variables Jacobian is shared, and the exponents sum to one, giving $$p_w(x)=Z_w^{-1}p_y(x)^w r_u^y(x)^{1-w}.$$ Thus, source tilting transfers exactly to output tilting between $p_y$ and $r_u^y$. It recovers the desired tilt relative to the marginal data density $p_u$ when $p_y$ matches the conditional data density and $r_u^y=p_u$. Conditional-transport training constrains the former; the latter is an additional reference-distribution condition. **Endpoint responses characterize the first-order relation to velocity CFG.** With finite second moments, a realizable mean model at the population optimum, and independent condition dropout, NLL gives $\mu_y=\mathbb{E}[X\mid y]$ and $\mu_u=\mathbb{E}[X]$. Along $\dot{x}_t=v_y(x_t,t)$, let $g_t=v_y(x_t,t)-v_u(x_t,t)$, $A_t=\partial_xv_y(x_t,t)$, and $\dot{J}_t=A_tJ_t$ with $J_0=I$. Differentiating at $\eta=0$ for $w=1+\eta$ gives $$\dot{P}_t=A_tP_t,\quad P_0=d;\qquad \dot{G}_t=A_tG_t+g_t,\quad G_0=0,$$ $$P_1=J_1d,\qquad G_1=J_1d_{\star},\qquad d_{\star} = \int_0^1J_t^{-1}g_t\\,dt.$$ Under local twice differentiability and bounded relevant derivatives, $$\lVert x_1^{\mathrm{PG}}(\eta)-x_1^{\mathrm{CFG}}(\eta)\rVert \le |\eta|\\,\lVert J_1(d-d_{\star})\rVert +C\eta^2.$$ First-order endpoint matching requires $d=d_{\star}$. NLL learns a class-shared mean direction $d$, whereas $d_{\star}$ can vary across trajectories. We measure the resulting response difference directly. Using 1,000 paired class/noise inputs, centered finite differences in FP32, and perturbation size 0.03, the mean cosine similarities to the velocity-CFG endpoint response are: | Source direction | 20 steps | 50 steps | | --- | ---: | ---: | | Conditional − null | 0.2630 | 0.1882 | | Random | 0.0014 | 0.0026 | | Permuted label | 0.0721 | 0.0667 | The conditional–unconditional direction has weak positive correlation with the velocity-CFG response, above the random and label-permuted controls; mean relative errors are 1.08 and 1.17 at 20 and 50 steps. Together with the W1 / Q1 ablation, the results establish the generation benefit of this direction and quantify its limited first-order alignment with velocity CFG. **Planned manuscript revision.** Clarify first-order responses and density reweighting in Section 4.3 (p. 5) and Appendix B (pp. 16–23), with endpoint diagnostics in Appendix C (pp. 24–27).Response to Authors
Thank you for the detailed response and the additional experiments. The norm-matched direction ablation and the extended scale sweep are informative. However, my main concerns remain.
-
Clarification on "residual." By "residual," I did not mean an arbitrary perturbation direction in source space. I meant the residual parameterization of the source transformation: instead of learning a direct transformation f(x), P-Guide parameterizes the source as x + f(x), i.e., z = ε + αμ(y), and the guided source z_cfg = z_c + α(w−1)(μ(y) − μ(∅)) keeps this residual form. The direction ablation shows that the conditional–null direction carries conditional information. It does not tell whether the improvement comes from the CFG-inspired linear extrapolation or from the residual parameterization itself.
-
Comparison with direct source-transformation baselines. To separate these two effects, P-Guide should be compared with methods that learn a direct (non-residual) source transformation z = f(ε, y), such as CAR-Flow, CSFM, and NoiseRefine, under unified settings (same backbone, training budget, NFE, and evaluation protocol). Together with P-Guide at w = 1 (residual source without extrapolation) and at w > 1, this comparison would show how much of the gain comes from the residual parameterization and how much comes from the extrapolation. The fixed-CSFM experiment shows that P-Guide can be applied on top of an existing conditional-source model, but it is not such a comparison, and NoiseRefine is not addressed in the response. Moreover, at CFG = 1, P-Guide improves FID only from 7.07 to 6.91 on the CSFM checkpoint, and FID worsens at PG = 2, which suggests that much of the benefit may come from source learning rather than from the extrapolation itself.
Summary. I appreciate the authors' efforts and the honest analysis in the response. Because the gains from linear extrapolation have not been separated from those of the residual parameterization, and direct comparisons with existing source-transformation methods are still missing, I will maintain my original rating.
Thank you for your suggestions on source-space guidance. The following ablations and fixed-checkpoint comparisons examine the conditional–unconditional direction and its value beyond source learning.
W1 / Q1
The norm-matched direction ablation identifies the conditional–unconditional mean contrast as an effective guidance direction. Sampling starts from
+(w-1)\alpha(\mu_c-\mu_u).$$ At $w=1$, this is the learned conditional source. We fix the source predictor, flow backbone, noise, and conditional standard deviation, replacing only the direction in the last term. Random and label-permuted directions are norm-matched in the conditional covariance metric. Evaluation uses the $\alpha=0.1$, 300K DiT-B/2 checkpoint, 50 Euler steps, and 50K images. Entries are FID; the $w=1$ reference is 30.32. | Source direction | w=1.2 | w=1.5 | | --- | ---: | ---: | | Conditional − null | 28.79 | 26.78 | | Reversed | 32.04 | 34.70 | | Random, norm-matched | 30.34 | 30.37 | | Permuted label, norm-matched | 29.86 | 29.30 | The conditional–unconditional direction gives the lowest FID at both strengths. Random directions remain near the unsteered control, while reversal worsens FID. These differences at fixed model weights and perturbation magnitude link the gain to the conditional information in the direction. **The useful extrapolation range depends on actual source displacement.** The same checkpoint gives: | PG | FID ↓ | KID ↓ | IS ↑ | Precision ↑ | Recall ↑ | Top-1 (%) ↑ | | --- | ---: | ---: | ---: | ---: | ---: | ---: | | 0.9 | 31.17 | 0.02576 | 44.51 | 0.4705 | 0.6514 | 42.64 | | 1 | 30.32 | 0.02465 | 45.69 | 0.4757 | 0.6477 | 43.46 | | 1.5 | 26.78 | 0.02007 | 50.45 | 0.4948 | 0.6297 | 46.87 | | 2 | 24.36 | 0.01654 | 54.47 | 0.5062 | 0.6113 | 49.03 | | 3 | 23.24 | 0.01314 | 57.21 | 0.4904 | 0.5841 | 49.63 | At $\alpha=0.1$, FID improves through $w=3$, reaching 23.24, while recall decreases. The actual perturbation is $(w-1)\alpha(\mu_c-\mu_u)$, so guidance strength should be read together with the source scale and mean contrast. This configuration supports FID gains over a wider coefficient range, with a fidelity–coverage trade-off. **Planned manuscript revision.** Emphasize source-space guidance in Section 4.4 (p. 5) and add the direction/scale ablations to Section 5.3 (pp. 7–9) and Appendix C (pp. 24–27). **W3 / Q2** **Thank you for suggesting a direct comparison. CAR-Flow and CSFM use conditional sources to improve flow-matching learning; P-Guide adds sampling-time guidance to a learned source.** On a fixed CSFM model, PG=1 retains the original conditional source and other scales adjust only its mean, directly testing guidance after source learning. The comparison fixes the 280K CSFM checkpoint, source encoder, flow backbone, and conditional variance, varying only PG and CFG. All settings use the same native-BF16 sampler, 20 Euler steps, 50K images, and the original CSFM FID protocol. | PG | CFG | NFE | FID ↓ | IS ↑ | Top-1 (%) ↑ | CLIP ↑ | | ---: | ---: | ---: | ---: | ---: | ---: | ---: | | 0.9 | 1 | 20 | 7.24 | 160.11 | 65.77 | 0.33641 | | 1 | 1 | 20 | 7.07 | 164.14 | 66.19 | 0.33731 | | 1.5 | 1 | 20 | 6.91 | 180.17 | 67.66 | 0.33926 | | 2 | 1 | 20 | 7.16 | 183.93 | 67.80 | 0.33996 | | 0.9 | 2 | 40 | 6.53 | 156.10 | 67.02 | 0.34409 | | 1 | 2 | 40 | 6.40 | 159.93 | 67.67 | 0.34480 | | 1.5 | 2 | 40 | 5.79 | 177.30 | 69.32 | 0.34671 | | 2 | 2 | 40 | 5.73 | 186.78 | 69.96 | 0.34759 | At CFG=1, increasing PG from 1 to 1.5 reduces FID from 7.07 to 6.91 and raises CLIP from 0.33731 to 0.33926. PG=2 further improves IS, Top-1, and CLIP, with FID of 7.16. At CFG=2, PG=2 reduces FID from 6.40 to 5.73 and raises CLIP from 0.34480 to 0.34759. Source guidance thus offers an adjustable quality–alignment trade-off on the same model and improves both FID and CLIP when combined with velocity CFG. The comparison demonstrates P-Guide's extension of an existing conditional-source model and its complementary role alongside velocity CFG. The related-work revision will distinguish source construction or refinement in CAR-Flow, CSFM, and NoiseRefine from sampling-time control of a learned source. **Planned manuscript revision.** Clarify the related methods in Section 2 (p. 2) and add the paired fixed-CSFM-checkpoint comparison to Section 5.3 (pp. 7–9).