- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes AFD: Adversarial Flow Distillation for adapting pretrained autoregressive video generators using only completed videos from a black-box teacher. The paper trained a prompt-conditioned Bradley–Terry discriminator to distinguish teacher samples from current student rollouts. Its scores provide weights for a DiffusionNFT objective, supplemented by a reference-model regularizer. The paper also analyzes idealized density-ratio reweighting and its effect on conditional flow-matching targets. Experiments cover Self-Forcing and Causal-Forcing, with additional teacher and architecture variants, and report improvements on selected VBench dimensions and automatic physics evaluations.
Critical strengths
-
The black-box teacher setting is practically relevant: adapting efficient students using only completed teacher videos avoids requiring access to proprietary model internals.
-
Experiments cover multiple students and teachers, with an independent physics diagnostic and feedback ablations providing preliminary support for the effectiveness of adaptive discrimination.
-
The population analysis provides a useful interpretation of the discriminator signal through density-ratio reweighting and explains how sample-level weights affect conditional flow-matching targets. This offers theoretical motivation for the method under idealized assumptions.
-
The method supports distillation from teachers accessed only through a video-generation API, without requiring teacher scores or internal states. This makes it applicable to both open-source and proprietary models, including teachers with different architectures and sampling procedures.
Critical weaknesses
- The paper does not clearly establish its methodological distinction from APT2, One-Forcing, AAD-1, and Astrolabe. In particular, APT2 already combines autoregressive student-forcing rollouts with an online discriminator, using adversarial feedback to improve generation under student-generated histories. Astrolabe already applies NFT-based forward-process optimization to distilled autoregressive video models, including online rollouts, reward normalization, and positive/negative updates without backpropagating through complete sampling trajectories. AFD therefore appears to combine two established components: adaptive adversarial feedback, as in APT2, and NFT-based student optimization, as in Astrolabe. Relative to Astrolabe, its principal change appears to be replacing the externally specified reward with a teacher--student discriminator; relative to APT2, it changes how discriminator feedback updates the generator. These differences may be useful, but the paper does not sufficiently explain what additional methodological insight they introduce or demonstrate their value through controlled comparisons. The generic GAN baselines and limited discussion of these closely related methods leave the significance of the contribution unclear.
- The uniform-weight ablation is difficult to reconcile with the stated objective. Equation (4) defines the positive and negative branches using the current prediction with stop-gradient. Both branches therefore have the same forward value, while their derivatives have opposite signs. For fixed rollout samples and targets, the resulting NFT gradient is proportional to and vanishes when . However, Table 11 reports substantial improvements under this setting, with Physics VBench increasing from 68.49 to 81.74. If the student and reference models are initialized identically, the prior regularizer also initially provides zero gradient. Please clarify what produces the learning signal in this ablation, including whether the implementation uses an old/EMA predictor instead of the detached current prediction, a different initialization, or additional losses. This discrepancy limits confidence in the interpretation of the ablation.
Questions for authors
-
What is the methodological contribution beyond combining an online teacher--student discriminator with existing NFT-based optimization? Astrolabe already uses online rollouts for NFT-based AR video optimization, while APT2 already performs student-forcing adversarial training. Please clarify what is novel about the claimed on-policy formulation and what controlled evidence distinguishes AFD from these approaches.
-
The introduction motivates AFD through the difficulty of assigning video-level feedback to individual frames or denoising states. However, the NFT update appears to reuse a single rollout-level weight across its forward-noised training states. What credit-assignment mechanism does AFD introduce beyond standard NFT? Equation (12) explains how reweighting changes conditional flow targets, but does not identify which frames or steps caused the reward. Please clarify whether the claim concerns fine-grained credit assignment or only the propagation of sample-level feedback into dense training gradients.
-
Few-step generators and adversarial training can both suffer from mode collapse. How does AFD behave when a few-step student produces low-diversity rollouts with similar discriminator scores? In this case, centered NFT advantages may provide limited learning signal. Could the authors clarify whether the NFT update and reference-model prior can help restore diversity, and whether this behavior has been evaluated?