- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes FANFT, which extends DiffusionNFT by introducing local directional supervision alongside image-level reward learning. The method uses CFG-derived coordinates and same-state symmetric interventions to identify reward-preferred velocity directions, then integrates these signals with the global NFT gradient through agreement-controlled fusion.
Critical strengths
- FANFT presents an interesting approach to reward-based learning by complementing image-level reward supervision with locally measured directional information. The use of same-state symmetric interventions and agreement-controlled gradient fusion is a meaningful contribution.
- The frozen-policy experiments support the informativeness of CFG-derived coordinates, while the training ablations provide evidence for the usefulness of directional updates.
Critical weaknesses
- Absence of qualitative results. The paper provides no generated-image examples, making it difficult to assess whether higher reward scores correspond to meaningful visual improvements or introduce quality trade-offs, particularly given the weaker PickScore results.
- The incremental contribution and generalizability of CFG-based directional learning remain somewhat limited. Random 2D performs nearly as well as FANFT on OCR, and the improvement over Antithetic NFT is modest on GenEval. The results suggest that the benefits depend strongly on the reward task, while the effectiveness of directional exploration at later diffusion steps remains unexplored.
Questions for authors
- Could the authors provide qualitative comparisons to demonstrate the visual improvements and potential trade-offs associated with FANFT?
- How much of FANFT's improvement is specifically attributable to CFG-derived coordinates, given the competitive Random 2D results on OCR?
11 comments
Follow-up to Reviewer o4i7: Manuscript Revisions
Thank you again for your questions. We have incorporated the qualitative comparisons and CFG-specific coordinate tests from our earlier response into the revised manuscript. Revisions are marked in blue; all references below use the revised PDF's numbering.
Q1. Generated-image comparisons and reward-dependent effects. We added Section 5.5 (p. 9) and Figure 5 (p. 10). The figure presents six matched cases with SD3.5-M (Base), DiffusionNFT, and FANFT in rows: three GenEval object/spatial-relation cases and three OCR spelling/phrase-completeness cases. Each column uses the same prompt, initial latent, and inference settings across methods.
Appendix E.6 (pp. 35–36) describes the gallery protocol and the separate 64-pair-per-task checkpoint evaluation. Tables 22–23 (p. 36) report target and non-target rewards with paired confidence intervals, while Table 24 (p. 36) gives the full prompts and gallery identifiers for the main figure. Figure 22 (p. 37) adds matched examples across all four reward tasks, including HPSv2 and PickScore. Figure 23 (p. 38) shows the image changes produced by clean, positive, and negative local interventions at matched solver states. The revised PDF therefore places the generated outputs, their prompts, and the accompanying reward measurements together.
Q2. The specific contribution of CFG-derived coordinates. We added the OCR matched-coordinate findings to Section 3.2 (pp. 4–5) and revised Section 5.4 (pp. 8–9) to distinguish local coordinate information from complete training outcomes.
Appendix E.3 and Figure 20 (p. 33) specify the equal-query-budget CFG-versus-random comparison, including the matched state, dimension, shared auxiliary axis, action norm, held-out directions, and prompt-cluster uncertainty. Figure 21 (p. 34) reports the fixed-rule confirmation on 48 new prompts. These additions directly locate the CFG-specific evidence alongside the coordinate ablation in Table 3 (p. 9).
We also incorporated the five-seed no-write and Antithetic NFT training comparisons in Table 2 (p. 9), with details in Appendices E.1–E.2 (pp. 31–33). This lets the manuscript distinguish the information provided by the residual coordinate from the learning benefit of applying directional credit, including the comparison against Antithetic NFT noted in your review.
These additions connect the image-level evidence, the controlled coordinate tests, and the training comparisons within the paper itself.
Follow-up on Qualitative Results and Revised Manuscript
Dear Reviewer o4i7,
Thank you again for your thoughtful review and helpful suggestions. In our earlier responses, we provided matched Base/DiffusionNFT/FANFT image comparisons, target and complementary reward evaluations, and a frozen OCR experiment comparing CFG-derived coordinates with matched random coordinates at equal query budgets. We also evaluated a fixed local-decision rule on new prompts. The revised manuscript now incorporates these results, including a six-case comparison in the main text and additional images, signed-intervention examples, and experimental details in the appendix. Changes are highlighted in blue.
We would greatly appreciate your feedback on whether the visual comparisons and controlled coordinate tests address your questions, or whether further clarification would be useful. We would welcome any additional questions or suggestions before the discussion period closes so that we can address them within the remaining discussion time.
Your suggestions have helped us make the generated-image comparisons more informative and separate the CFG residual’s contribution to local reward information from the training benefit of directional writing.
We sincerely appreciate your time and consideration.
Best regards,
The Authors
Response to Reviewer o4i7
We thank the reviewer. We address the two questions with matched images and equal-budget tests of the reward information supplied by CFG-derived coordinates.
Anonymous supplementary material: https://anonymous.4open.science/r/Response-to-Reviewer-o4i7/ — The page contains all 240 matched image groups, target/non-target reward tables, frozen OCR coordinate tests, confirmation on 48 new prompts, and clean/positive/negative intervention panels, with experiment settings and figures.
Q1. Visual improvements and trade-offs
We provide 240 matched Base/DiffusionNFT/FANFT groups (720 images), with 60 groups for each of GenEval, OCR, HPSv2 and PickScore. Each group shares its prompt, initial latent and inference settings: 40 steps, CFG 4.5, and 512 × 512 resolution. The galleries allow direct comparison of object arrangements, rendered text and appearance.
For example, GenEval Case 01 requests a blue book to the left of a yellow vase and a red apple to its right; OCR Case 02 specifies the phrase “Jasmine at Dusk.” Presenting each prompt with all three outputs makes the requested content directly inspectable.
A separate fixed evaluation uses 64 matched prompt–latent pairs per task:
Intervals use paired prompt bootstrap with the checkpoints fixed. On the same images, non-target PickScore differences for GenEval- and OCR-trained models are -0.00224 [-0.00707, 0.00269] and -0.00371 [-0.01058, 0.00292], respectively. The page also reports complementary preference scores for HPSv2- and PickScore-trained models. HPSv2 is score × 100; PickScore is logit / 26.
The galleries show content and appearance changes, while the paired scores quantify their target-reward and preference profiles under shared inference conditions.
Q2. CFG-derived coordinates versus Random 2D
The OCR training AUCs, 0.95804 for FANFT and 0.95696 for Random 2D, compare complete training configurations. To isolate the coordinate's contribution, we replace the CFG-derived first axis with a matched random axis while fixing the model state, prompt, latent, two-dimensional basis size, shared second axis, action norm and query budget.
The test uses 48 prompts × 3 states × 4 held-out directions = 576 pairs per design. A/B directions fit the local reward response; separate C directions test it. Mean signed branch advantage is 0.02091 for CFG versus 0.00599 for random, a paired gain of +0.01492 [95% CI: 0.00738, 0.02319]. Positive advantage means the prediction points toward the higher-reward branch. The ratio of means is 3.49× [2.00, 7.40] at equal query budget.
Correct-direction yield is 153/576 (26.56%) for CFG versus 84/576 (14.58%) for random: +11.98 pp [6.94, 17.19], or a 1.82× ratio [1.41, 2.51]. Ties and abstentions contribute zero, and all pairs remain in the denominator. These measures therefore compare useful information across the full matched budget.
We then fixed the decision rule before testing 48 previously unused prompts, with 144 states per design. Mean reward gain over clean images is +0.03459 for CFG versus +0.01267 for random, yielding +0.02192 [0.00266, 0.04174] for the paired difference. Every state enters the estimate, including states where the rule retains the clean output. Thus, the additional coordinate information supports better local reward decisions on new prompts.
The two experiments have complementary roles: training controls measure the value of directional writing; frozen coordinate replacement identifies the information supplied by CFG. Clean/+σu/−σu panels visualize the tested intervention at the first conditional velocity, followed by deterministic 10-step DPM2 with behavior CFG 1. Together, the matched images and coordinate tests connect visible generation behavior with FANFT's local reward-query construction.
If you have any further questions, please feel free to discuss them with us!