- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes FLARE, a factorized latent reward model for autoregressive video generation, quality signals are directly predicted in the VAE latent space by sharing the DiT backbone with three learnable query headers (semantic alignment/visual quality/dynamic quality). The reward model is trained in two stages: first doing generic preference SFT, then doing latent adaptation with majority voting labels from multiple pixel spatial evaluators, and then jointly optimizing the generator with DMD stream distillation as a frozen differentiable critic. The paper claims consistent improvement in different settings, and ablation experiments verify the effectiveness of the decomposition design.
Critical strengths
-
Problem setting is important and practical. Semantic drift, visual quality attenuation and motion degradation in long video generation are the core bottlenecks of autoregressive video generation. This paper attempts to provide fine-grained quality reward along with DMD to alleviate consistency and motion quality degradation caused by error accumulation in long video inference.
-
The factorized rewards are reasonable and well designed. Instead of compressing all preferences into a single scalar, the paper split reward into three heads: semantic alignment, visual quality, and dynamic quality, and helped the model improve on their corresponding dimensions.
-
The two-stage reward training strategy is more complete. Firstly, Bradley-Terry SFT is performed using the general preference data, and then the target domain adaptation is performed using the consistency signals of multiple pixel-space evaluators, which helps to obtain the general preference ability and long video target domain adaptation at the same time.
-
The experimental coverage is more comprehensive. The paper evaluates not only interactive 60-second generation, but also single-prompt long video generation and regular 5-second short video generation, indicating that the method is not only effective in specific interaction scenarios.
Critical weaknesses
-
The training details of the reward model in the latent preference adaptation stage are missing, such as the magnitude of the training data set and the performance of the corresponding test set.
-
The paper emphasizes the advantage of reward in latent space, but does not give the corresponding experimental data, such as performance or efficiency in the latent space compared with the pixel space.
Questions for authors
-
Besides the reported gains in subject consistency, background consistency, and motion smoothness, how does latent reward optimization affect other evaluation dimensions? Are there any dimensions that improve less, remain unchanged, or degrade after applying FLARE?
-
Could the authors provide a duration-wise or segment-wise analysis of subject consistency, background consistency, motion smoothness, and imaging quality across different generation lengths, e.g., 10s, 20s, 30s, 40s, 50s, and 60s, to verify the effectiveness of the improvement for chunk error accumulation.
-
Could the authors provide more implementation details of the single-head baseline in Tab. 7? Specifically, does it use a single reward query and a single scalar head, or does it aggregate the three aspect labels/scores into one overall preference objective?
-
Since one key motivation of latent-space reward is to avoid expensive pixel-space reward inference, could the authors provide a quantitative efficiency comparison against pixel-space reward computation, such as GPU memory usage and inference time cost?
-
In CLPA, UnifiedReward-Flex is used for all three aspects, while VideoAlign and UniPercept are used selectively. What is the rationale behind choosing UnifiedReward-Flex as the common evaluator across all dimensions? Could the authors provide an ablation or analysis comparing different evaluator combinations for CLPA.
-
Could the authors report the agreement between each weak evaluator (VideoAlign, UnifiedReward-Flex, and UniPercept) with human preferences on the internal long-horizon autoregressive test set?
Further concerns regarding the response to Q1 and Q2
It is suggested to supple the comparison of baselines (Wan2.1 and methods in Tab.1), DMD-only, and the proposed method across all VBench dimensions, so as to better reflect how the quality varies across different evaluation metrics. In particular, given that the Temporal flickering scores are close, it would be useful to examine whether applying the proposed post-training to the baseline introduces any impact on other dimensions.
It is suggested to supplement the Wan2.1 model (baseline) with dmd-only and the full comparison of FLARE.