- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents Sword, an action-conditioned world model for VLA reinforcement learning, targeting visual generalization and long-horizon prediction consistency. It introduces Structure-Guided Style Augmentation (SGSA), which uses depth, segmentation, and task information to generate visually diverse training videos, and Dynamic Latent Bootstrapping (DLB), which incorporates cached model predictions as training contexts. The method is evaluated on LIBERO-Spatial through video prediction metrics, component ablations, and GRPO post-training of OpenVLA-OFT. The authors report improved prediction quality under original and held-out style conditions, along with higher downstream policy success rates than training with WoVR.
Critical strengths
None
Critical weaknesses
-
The incremental contribution over prior work is insufficiently established, particularly for SGSA.
Seeing Realism from Simulation: Efficient Video Transfer for Vision-Language-Action Data Augmentation already uses depth conditioning, task-related text, and Cosmos-Transfer 2.5 for robotic video augmentation, substantially overlapping with the main SGSA pipeline. The manuscript neither discusses this directly relevant work nor provides a controlled comparison demonstrating the additional value of its design choices, such as segmentation conditioning. Comparing augmentation against no augmentation establishes its usefulness, but does not establish an advance over existing augmentation methods. This weakens the positioning of SGSA as a major methodological contribution. -
The benchmark coverage is too limited to substantiate the generality of the claimed robustness and downstream utility.
All experiments are confined to LIBERO-Spatial, a single task suite, without evaluation on other LIBERO suites, independent simulation benchmarks, or real robots. LIBERO-Raw and LIBERO-Mixed are evaluation settings derived from the same task source, differing primarily in the inclusion of synthetic visual changes; they do not constitute independent benchmark coverage. The reinforcement learning evaluation is similarly restricted to LIBERO-Spatial, using only OpenVLA-OFT with GRPO and comparing Sword against WoVR as the training environment. Policy post-training under style-transferred conditions remains future work. Consequently, the current evidence does not establish whether the reported benefits extend across different tasks, environments, and interaction dynamics. This narrow experimental scope is a substantial limitation for a paper motivated by robust world models for VLA reinforcement learning. -
The component analysis does not sufficiently isolate the value of key design choices or their contribution to downstream policy improvements.
The paper includes a complete SGSA × DLB ablation and comparisons of eight cache configurations. However, these experiments primarily establish module-level effectiveness, without sufficiently explaining the contribution of the specific mechanisms. SGSA lacks controlled ablations isolating depth, segmentation, and task-text conditioning. DLB lacks direct comparisons, under the same backbone, against alternative strategies for mitigating the training–inference distribution mismatch. Moreover, the component ablations primarily report video prediction metrics, without establishing how each component contributes to downstream policy success. The current analysis therefore provides limited evidence attributing the final gains to the particular mechanisms emphasized in the paper.
Questions for authors
-
Novelty relative to prior work: What are the substantive technical differences between SGSA and Seeing Realism from Simulation: Efficient Video Transfer for Vision-Language-Action Data Augmentation? Can a controlled comparison establish the additional benefit of SGSA’s segmentation conditioning over the prior depth-and-text-guided augmentation pipeline?
-
Benchmark coverage: Can you provide results on an additional LIBERO task suite or an independent simulation benchmark? Since both LIBERO-Raw and LIBERO-Mixed derive from LIBERO-Spatial, such evidence would materially affect my assessment of whether the reported gains generalize beyond the current task distribution.
-
RL evaluation protocol: Where are the policy success rates in Table 2 measured—in the original LIBERO simulator or in a learned world model? How are rewards, success, and termination determined during world-model-based training? Please also specify the number of seeds and evaluation trials, and report variability across runs.
-
Component attribution: Do SGSA and DLB individually improve downstream policy success under a matched training budget? Can you provide a policy-level component ablation and a same-backbone comparison of DLB against a simpler strategy for mitigating the training–inference context mismatch? These comparisons would help establish which mechanisms account for the reported benefits.