- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
WorldAlign aims to improve world consistency in video generation by decoupling rewards for static backgrounds and dynamic subjects. It uses semantic tracking masks to evaluate background reprojection consistency and introduces a camera-motion reward to mitigate “static degradation.” Subject motion and appearance consistency are assessed through sample-specific VLM checklists. These three rewards are used for GRPO post-training, with experiments conducted on two pretrained video generators.
Critical strengths
- The project page provides numerous generated examples that illustrate WorldAlign’s advantages over the baselines.
- The paper addresses an important and well-motivated problem.
- The paper is well written and clearly explains the existing challenges and the specific issues the method aims to resolve.
Critical weaknesses
- While the identified problem is valid, the proposed solution relies heavily on checklist-based VLM scoring without establishing its agreement with human judgments or objective measures of consistency. Answers to checklist questions may not reliably reflect the correctness of subject motion and appearance. A comparison with human annotations or independent metrics would help substantiate the reward’s validity.
- The method uses VGGT to estimate point clouds and camera parameters from the full video before removing points associated with dynamic subjects. However, these subjects may already have affected the estimated camera parameters and background geometry. Filtering out their points afterward does not necessarily correct those errors. The authors should assess the robustness of this procedure in scenes with substantial subject motion.
- The paper does not report Flow-GRPO training curves, making it difficult to assess convergence, stability, and potential reward exploitation. Additional training details and curves showing reward evolution and independently measured performance would strengthen the experimental evidence.
- The Checklist “Yes” Rate closely follows the evaluation procedure used to construct the dynamic reward. Improvements on this metric may therefore reflect optimization toward the reward evaluator rather than broader gains in world consistency. Independent evaluations are needed to substantiate the metric’s validity and support claims of improved physical reasoning.
Questions for authors
I hope the authors to solve my weakness above.
6 comments
Author Response to Reviewer r8k7 - (2/2)
Weakness 4
The Checklist “Yes” Rate closely follows the evaluation procedure used to construct the dynamic reward. Improvements on this metric may therefore reflect optimization toward the reward evaluator rather than broader gains in world consistency. Independent evaluations are needed to substantiate the metricʼs validity and support claims of improved physical reasoning.
Thanks for your comment. We have reported independent human evaluation in our original supplementary material. We have now moved these results to Sec. 4.3 (Tab. 2) of the main paper. Human raters directly assess static consistency, dynamic consistency, and overall preference, and WorldAlign outperforms the compared methods across these criteria.
Thanks for the authors' response. In Figure B in the Appendix, the Checklist Yes Rate curve shows only a slight increase, suggesting that this reward component makes a relatively limited contribution to the overall results, which somewhat weakens the novelty of the proposed design. Furthermore, the overall experimental design does not introduce substantial innovations over World-R1. Although certain components, such as the decoupled 4D reward may indeed be effective, I do not believe the current evidence is sufficiently compelling to warrant a positive assessment. Therefore, I maintain my original score of Weak Reject.
Author Response to Reviewer r8k7 - (1/2)
Weakness 1
Thanks for recognizing the identified problem is valid. To address your concern about the rewardʼs reliability, we report the agreement between our VLM judge and human annotations.
We randomly select 100 prompts from the training dataset and generate one video per prompt using a random inference seed. Human annotators provide Yes/No labels for four dimensions: subject motion, physical plausibility, shape preservation, and texture preservation, which are the four dimensions used in our dynamic reward. This gives 400 human labels in total. We compare these labels with Qwen3.6-Plusʼs answers using our sample-specific checklists. The VLM judge achieves 78.0% agreement with human annotations (312/400). For comparison, we use a VisionReward-style generic checklist covering the same four dimensions yields only 64.25% agreement (257/400). These results validate the effectiveness of the proposed vlm reward.
The rewardʼs effectiveness is also reflected in the videos generated after training. Our independent human evaluation shows that WorldAlign outperforms the compared methods in static consistency, dynamic consistency, and overall preference. We have moved the human evaluation to Sec. 4.3 (Tab. 2) of the main paper from supplemetary material. This provides further evidence that the proposed rewards are effective.
Weakness 2
Thanks for your constructive suggestion. Indeed, VGGT is not the strongest geometry estimation method for dynamic scenes as proven in paper PAGE-4D[1]. However, it is well-established and widely recognized, and still performs well in most cases, as reflected in the improvements shown by our human evaluation and qualitative results. This is the reason we still use it as our geomety foundation model.
We also want to clarity that our method is not limited to specific models. As the field advances, VGGT can be replaced with newer geometry estimators for dynamic scenes, such as PAGE-4D. Gemini-3.1-Pro-Preview could likewise be replaced with a newer model such as Gemini-4-carbon. Even with stronger models, semantic decoupling remains necessary to penalize static inconsistencies without suppressing valid subject motion. Our checklist-based VLM scoring also remains necessary to improve dynamic consistency. The core reward design therefore remains essential as the underlying models improve.
Overall, we sincerely hope you can consider the contribution of our decoupled 4D reward and the improvements demonstrated by our experiments, rather than our current implementation.
[1] PAGE-4D: DISENTANGLED POSE AND GEOMETRY ESTIMATION FOR VGGT-4D PERCEPTION
Weakness 3
Thank you for the suggestion. We now provide Flow-GRPO learning curves for both backbones, including rewards on the training and test sets and independent metrics on the test set (Figs. B and C). As training progresses, both training and test rewards generally improve, alongside lower M.Epi. and higher Subject DINO and VBench scores. These trends support stable training and show that the improvements extend to metrics not used as training rewards