- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
AdvantageFlow performs reward-related regression-based prediction on images generated by a rollout flow model and incorporates a regularization term involving the rollout and reference model predictions. Essentially, AdvantageFlow builds upon AWM by adding a regularization term and provides a series of mathematical proofs to support this approach.
Critical strengths
- The paper involves a significant number of mathematical formulas and provides closed-form proofs, although these proofs are somewhat verbose;
- Experiments were conducted on multiple datasets to demonstrate the effectiveness of the proposed method;
Critical weaknesses
- The writing style feels heavily AI-generated; the introduction and abstract fail to clearly distinguish AdvantageFlow from DiffusionNFT and AWM, or to highlight the core improvements. Regarding lines 64–66, the core concept described is already shared across existing Diffusion RL methods and cannot be considered a unique contribution of this paper. Furthermore, the explanation of why AdvantageFlow qualifies as a least-squares algorithm (lines 77–78) is unclear.
- Regarding the methodological contribution, my understanding is that the authors simply added a regularization term to AWM to impose constraints and prevent gradient divergence; there appear to be no other significant innovations.
- Regarding the experiments: how were and determined? Why are the numerical results for the GenEval evaluation so low?
Questions for authors
In my view, this is an incremental study—essentially adding a regularization term and providing some additional mathematical proofs—without empirical backing (such as demonstrating the specific conditions under which gradient divergence occurs). I strongly suspect that AI was used to generate much of the verbose mathematical proof. See the Weaknesses.