- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes COAL (Covariance-Amortized Likelihood), a Jacobian-free likelihood estimation method for Rectified Flow models. The key idea is to exploit a relationship between the divergence of the optimal Rectified Flow velocity field and the trace of the conditional covariance of its velocity target. Based on this identity, the authors introduce an auxiliary variance prediction head trained with a Gaussian negative log-likelihood objective. This enables deterministic likelihood estimation without computing Jacobian-vector products or using Hutchinson trace estimators during inference. Experiments on a 2D checkerboard distribution and ImageNet-256 demonstrate that COAL achieves accurate likelihood estimates with substantially reduced computational overhead. In particular, the method achieves comparable BPD-RMSE to Hutchinson estimation with approximately 3.5× less evaluation compute.
Critical strengths
-
The paper introduces an approach to likelihood estimation by leveraging the mathematical structure of Rectified Flows. Although the underlying conditional covariance identities and Gaussian variance estimation techniques are established, combining them into a Jacobian-free likelihood estimator is a meaningful methodological contribution.
-
Proposition 3.1 provides a clear mathematical foundation for the proposed estimator under the stated assumptions. The resulting algorithm is relatively simple, requiring only an additional variance prediction head and a modified training objective, without introducing complicated inference procedures.
-
The experiments demonstrate close agreement with the Hutchinson reference while significantly reducing computational cost. The reported improvements in GPU throughput and memory efficiency are particularly valuable for likelihood evaluation in high-dimensional generative models.
-
The paper investigates several important design choices, including per-coordinate variance prediction, variance branch depth, and boundary parametrization. The additional bias-variance analysis provides useful evidence for understanding the estimator's empirical behavior.
Critical weaknesses
-
Unlike Hutchinson estimation, which can be directly applied to pretrained velocity networks, COAL requires training an auxiliary variance prediction head.
-
The method relies on the specific structure of Rectified Flow training, which may limit its applicability to other continuous normalizing flow models.
Questions for authors
-
Could the authors provide a comparison of training overhead and inference-time savings, particularly for scenarios where likelihood evaluation is performed infrequently?
-
Since the theoretical identity holds for the optimal velocity field, it would be interesting to investigate whether the likelihood estimation error changes significantly with the quality or convergence of the velocity model.
Thank you for the rebuttal! I will raise my score to weak accept (3).