- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes the WMSD framework, which transforms a pre-trained video generator into a task solver through self-distillation and reinforcement learning. The approach is somewhat insightful, and the experiments are fairly comprehensive. However, there are shortcomings in terms of evaluation reliability and baseline fairness, and the evidence supporting the core claim is not sufficiently robust.
This method uses a VLM to automatically generate data pairs consisting of tasks and detailed execution descriptions from unlabeled scene images. During the training phase, a frozen demonstrator guides a trainable executor, which takes only images and brief task descriptions as input, through on-policy self-distillation; simultaneously, the system performs joint optimization via reinforcement learning (e.g., FlowGRPO/AWM) by combining VLM-based task completion and consistency rewards. During the inference phase, the system only needs to use the pre-trained Executor, thereby eliminating the latency overhead associated with invoking a VLM for planning.
The main contributions of this paper include:
- Propose the WMSD framework, which transforms a pre-trained video generator into a data generator without the need for paired task-execution videos.
- Construct the WorldTasks dataset and the WorldTasks-Bench evaluation benchmark to assess the general task-solving capabilities of generated videos.
- Empirical results show that Executor achieved a task completion rate of 60.5% on the benchmark, outperforming the baseline model (28.5%) and the Demonstrator with privileged information (49.5%), and demonstrated strong zero-shot transfer capabilities on the DreamGen robot video benchmark and the Maze task based on verifiable rewards.
Critical strengths
Strengths:
- The introduction of Anchor Loss is an effective engineering design. This design effectively stabilizes the training process, alleviates the crashes commonly encountered in video generation RL, and serves as a valuable engineering reference.
- The experiments are fairly comprehensive, lending the paper a reasonable level of credibility.
Critical weaknesses
Main Concerns:
- The core modules used in the paper all have clear predecessors, and the paper itself acknowledges this in the “Related Work” section: “DMDR (Jiang et al., 2025) combines DMD with reward optimization,” and “AWM and FlowGRPO provide the optimization algorithms.” Therefore, this paper is more engineering-oriented and I recommended a more insightful algorithm tailored to the temporal characteristics of video. I suggest that the authors explain more clearly why this combination is necessary and unique in video generation.
- The paper claims that the consistency score improved from 0.694 to 0.882. However, the temporal stress test in Appendix C.1.2 shows: Table 17: Under the “Shuffle” condition, Qwen’s rejection rate was only 0.613; under the “Remove middle” condition, it was only 0.548. This implies that even when video frames are completely shuffled or middle frames are removed, the VLM still has approximately a 40%–50% probability of classifying the video as coherent. This suggests that the evaluator may not truly understand the physical logic of the actions. In this scenario, the model’s high scores may stem from catering to the evaluator’s preferences (“reward hacking”) rather than a genuine grasp of physical laws. I recommend supplementing the analysis with more reliable evaluation methods.
- The SFT baseline may not fully reflect the comparison. The paper attempts to demonstrate that WMSD outperforms traditional SFT, but the SFT baseline in Appendix A.2 uses “automatically annotated internet videos.” The paper itself acknowledges: “This lack of improvement may reflect the limited task-directed action in many routine internet videos.” This baseline is clearly underpowered. A fairer comparison would be to perform SFT directly on the Executor using videos generated by the Demonstrator and rated highly by the VLM. If WMSD cannot significantly outperform this “high-quality teacher data SFT,” then the necessity of its complex training process is needed or not?
Questions for authors
The abstract claims that WMSD is surpassing the Demonstrator (60.5% vs. 49.5%). However, Appendix B.3 clearly states that the p-value from the paired McNemar test is 0.093, which means this improvement is not statistically significant (p > 0.05). So, is it statistically significant or not?