- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
IFPO combines inversion-based and forward-noised preference supervision. A latent-variance statistic, calibrated on pretrained generation trajectories, determines when to fall back to forward noising; the winner’s decision is applied to both images. Experiments on SDXL and SD3.5 report preference gains, supplemented by checkpoint-switching diagnostics, static-hybrid controls, and an SDXL human study.
Critical strengths
- Distinguishing reconstruction fidelity from suitability for preference training is useful. The stage-wise DPO/InPO experiments provide an informative motivation for hybrid supervision.
- Results span diffusion and flow-matching backbones, with additional Parti-Prompts evaluation. The blinded human study and static-training comparison provide meaningful evidence of empirical benefit.
Critical weaknesses
- The sample-dependent fallback is only weakly distinguished from a fixed timestep cutoff. The fallback rate almost exactly matches the static schedule and the static-train variant recovers most of the improvement, yet the paper never reports how the decision varies across samples at a fixed timestep, so the reader cannot tell whether the calibrated variance test does anything beyond “fall back above some noise level.” The inference-time evidence for prompt matching rests on a generate–invert–reselect loop with a self-consistency criterion that has no principled justification and does not reflect the training-time method.
- The diagnosis is thinly supported and the proxy is crude. A single scalar variance over all latent coordinates cannot characterize distributional drift, and no direct measurement of the reachability gap (a distribution distance or a probe between inverted and generated latents per timestep) is given beyond one decoded example; the appendix derivation is a telescoping sum plus an alignment assumption that is never verified. The checkpoint-switching experiment mixes two separately trained models at inference, which tests which model is better at which step, not which supervision is better at which step.
- Gains are modest and the baselines look fragile. On the diffusion backbone the multi-dimensional preference metric does not improve over DPO on one of the two benchmarks, and on the flow backbone every reproduced baseline, including DPO, falls below the pretrained model, which signals an under-tuned setup in which IFPO’s own margin over the untuned model is small. The reproduced InPO is weaker than DPO on the training-distribution prompts, contradicting the original paper, so the effect size relative to the method’s own starting point is unclear, and the tolerance study spans a very narrow range with a backbone-dependent default that is not explained.
Questions for authors
- Does the variance score predict which training pairs benefit from inversion after controlling for timestep, and how often does the winner-only gate retain a badly drifted loser?
- Does IFPO outperform a shuffled training gate with identical per-timestep fallback rates across seeds and in direct human comparisons?
- Do the gains persist with more accurate inversion and calibration matched to training resolution at comparable total compute?
2 comments
Thank you for the additional experiments and clarifications. The shuffled-gate control and matched-resolution experiments have addressed important gaps in the evaluation. However, the gains over the shuffled gate are modest, with identical reported PickScore, so the benefit of sample-dependent selection remains unclear. Its connection to harmful drift is also not directly validated, and the comparison with more accurate inversion at comparable compute remains missing. I therefore tend to maintain my original score.
We thank the reviewer for recognizing the value of distinguishing reconstruction fidelity from suitability for preference training, and the evidence from our stage-wise experiments, backbone coverage, and human study.
1. Stage-wise supervision and sample-dependent selection (Q1, Q2)
(Q2, shuffled training gate) Following the reviewer’s suggestion, we trained a shuffled-gate control that preserves IFPO’s fallback rate at each timestep while randomly selecting which samples receive forward-noising supervision. All other training and evaluation settings are identical. Mean scores on the 500 Pick-a-Pic test prompts using SDXL are:
With per-timestep fallback rates matched, IFPO achieves comparable PickScore and higher mean HPS, ImageReward, and MPS. This provides additional training-time evidence for the benefit of sample-dependent supervision selection under the evaluated settings.
(Q1, variation within a timestep) We examined the first fallback occurrence for 500 samples on a 10-point inversion grid. The counts at timesteps 601, 701, 801, and 901 were 25, 332, 140, and 3. Thus, fallback has a strong timestep dependence while retaining sample variation. At timestep 701, at least 332 samples trigger fallback, while 143 have yet to trigger it. These observations demonstrate that samples receive different decisions at the same timestep. The shuffled-gate experiment above further tests the performance contribution of this sample selection.
The effectiveness of Static train also supports the stage-wise complementarity identified in our paper. Our contributions include identifying the mismatch between inverted supervision states and ordinary generation states, demonstrating stage-wise complementarity, and developing effective hybrid supervision informed by these findings. Fixed splitting is a simple implementation of this insight and forms part of our empirical contribution. IFPO further uses a calibrated variance criterion to select supervision. The Static train and shuffled-gate comparisons help distinguish the benefits of stage-wise supervision allocation and sample-dependent selection.
2. Scope of the variance criterion and pair-level selection (Q1)
(Q1, characterizing drift) A scalar variance statistic captures one aspect of the latent distribution. We use it as an inexpensive selection signal whose effectiveness is supported by training comparisons, including Static train and the new shuffled-gate control. Our claim concerns its empirical effectiveness as one implementation for mitigating inversion drift, with its optimality left open.
The diagnostic experiments provide complementary evidence. Checkpoint switching directly demonstrates the stage-wise complementarity of two trained models and motivates hybrid supervision. Static train, IFPO, and shuffled gate provide training-time comparisons of supervision rules. The appendix derivation describes drift accumulation under its stated assumptions.
(Q1, retaining a drifted loser) Among pairs where the winner remains below the threshold and inversion is retained, 3.56% of losers exceed the same threshold at the same timestep. This directly quantifies the frequency of retaining an above-threshold loser under winner-only selection.
We also trained alternative pair-level selection rules under identical SD3.5 settings. “Either” and “both” specify how many images must exceed the threshold to trigger fallback.
All four rules exceed the three baselines on all four unrounded means, with trade-offs across metrics. These results support winner-only as an effective choice and demonstrate gains across several pair-level rules. They appear in Appendix C.2, Table 7.
3. Baselines and resolution consistency (Q3)
(Q3, matched resolution) The additional SD3.5 experiments above use 512 × 512 throughout calibration, training, and inference, with λ=1, matching the SDXL default.
Under this setting, IFPO exceeds Base, Diffusion-DPO, and InPO on all four mean metrics. InPO also exceeds Base on all four means. These results provide a baseline comparison with consistent calibration and training resolution and show that IFPO remains effective with the shared λ=1 setting. They have been added to Section 5.3 and Appendix C.1, Table 6.