- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes ALIGN, a method that correlates the initial noise used for video and action generation in World Action Models. It learns a coupling subspace and strength while preserving the Gaussian distribution of each modality’s noise. Experiments on two WAM backbones show improved task success and agreement between predicted videos and actual execution.
Critical strengths
s1. The change is simple and keeps the original model architecture and generation process.
s2. The method improves both tested WAMs, with evaluations in simulation and on real robots.
Critical weaknesses
w1. The experiments show higher success rates and better video–execution agreement, but do not clearly establish that the gains come from coordinating the behavioral choices of the two branches. More direct evidence is needed to support this central claim.
w2. The appendix states that action-referenced and video-referenced sampling produce the same joint distribution for the same coupling parameters. It is therefore unclear why their performance difference supports the claim that using actions as the anchor is better.
w3. The final simulation gains are small, especially for the joint model. Results from multiple independent training runs are needed to show that these gains are reliable.
Questions for authors
q1. If we compare only successful rollouts, or only failed rollouts, does ALIGN still improve video–execution agreement?
q2. What differs between the action-referenced and video-referenced experiments, given their distributional equivalence at the same coupling parameters?
q3. Would a fixed random coupling achieve similar gains? How much does learning the coupling itself help?
q4. Do the gains hold across training seeds and after longer training?