- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes RayWAM, a World-Action Model that adapts pretrained video diffusion models for robot control by representing robot actions as visual Action Raymaps. The paper evaluates RayWAM on 3 simulation benchmarks and real world. The reported results show competitive performance using a 1.3B backbone without additional embodied pretraining.
Critical strengths
- Strong engineering integration and comprehensive experiments
Critical weaknesses
The core novelty of Action Raymap is unclear because it closely follows existing ray-based visual conditioning paradigms.
A key concern is that the core novelty of Action Raymap remains unclear, as it closely mirrors existing ray-based visual conditioning paradigms. Though presented as a novel action representation, it bears strong resemblance to established ray-based camera representations in diffusion models: camera trajectory control methods already use ray or Plücker-like encodings to provide dense spatial conditioning compatible with visual architectures. The primary distinction appears to be replacing camera poses with robot end-effector poses. The paper does not adequately justify why this constitutes a fundamental WAM contribution rather than a straightforward domain transfer.
The paper does not compare against the most relevant visual action conditioning baselines.
The most relevant comparison is not necessarily other robot policies. It should compare against methods that already perform: visual action prompts, camera/ray conditioning, trajectory image representations...... Without such comparisons, it is difficult to determine whether the improvement comes from: better representation or better architecture or simply stronger visual conditioning.
Questions for authors
Comparison with visual action prompt methods
Have the authors compared Action Raymap against:
- action images,
- optical flow actions,
- trajectory heatmaps,
- embodiment masks,
- other visual action conditioning approaches?
This comparison is important to establish superiority.