- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper focuses on representations of world-action models. Its core idea is to use the action objective to form a compact temporal representation. The world model predicts its evolution, with prediction loss forbidden from modifying the representation. Built on fastWAM’s framework, the model substitutes vision features with frozen DINOv3 features. It incorporates feature calibration using multi-layer aggregation, normalization and a representation-aware noise schedule and a Temporal Representation Bottleneck to encode continuous multi-view observations into compact states. It also implements Action-Grounded Representation Shaping, which restricts bottleneck updates exclusively to gradients from the action loss. This design lets the policy decide what information the representation holds, while the world model learns how this information evolves over time. During inference, ReWAM produces actions directly, balancing the inference efficiency and manipulation performance.
Critical strengths
- This work presents a clear principle for representation design. It studies representation construction for joint world prediction and robot control. Its core idea is to use the action objective to shape representations while the world model learns dynamics.
- Ablation studies show strong benefits for this controlled representation design. The experiments test feature calibration, temporal compression, representation dimension, and gradient routing. Specifically, the gradient-routing ablation validates AGRS' effectiveness in this framework.
- Both simulation and real robots show effectiveness of the proposed method. The paper uses two simulation benchmarks and real robotic manipulation tasks. Real-robot results indicate advantages for deformable objects and multi-stage tasks.
Critical weaknesses
- Generalization to other encoders and architectures remains unproven. The results are mainly for the DINO + Fast-WAM setup. TRB and AGRS have not been validated on VAE latents or other pre-trained features, which limits the method’s applicability as a general representation approach for WAMs.
- The contribution of world co-training to the complete method remains unclear. Table 9 removes the world prediction loss only from the raw DINO configuration, showing a modest benefit in that setting. It does not establish whether world co-training remains beneficial after feature calibration, TRB, and AGRS are introduced, leaving its contribution to the final ReWAM performance unresolved.
- The statistical significance of simulation performance gains is unclear. Table 1 shows a small improvement from 92.8% to 93.6% over the strongest baseline. Without results across independent training seeds or confidence intervals, we cannot tell whether this gain comes from the method itself or random noise. The nearly saturated performance further weakens this comparison. Evaluations in less saturated settings — for instance, training on clean demonstrations and testing on both clean and randomized scenes — would better demonstrate robustness and generalization.
Questions for authors
- Regarding generality, which components are DINO-specific, and which should transfer to other encoders or WAM architectures? Could the authors provide a targeted alternative-encoder experiment or clarify the architectural assumptions behind AGRS?
- To address the attribution concerns, how does complete ReWAM perform without the world loss? Additionally, in Table 4, reconstruction-pretrained bottlenecks are frozen during WAM training, whereas AGRS updates the bottleneck using action loss. How would reconstruction-pretrained bottlenecks perform if they were also allowed to adapt through action loss?
- Do representation and gradient-routing gains persist with longer training and across independent seeds? Please also clarify whether the Fast-WAM baselines match model capacity, initialization, and training budget, distinguishing generative video pretraining from embodied pretraining. Because fastWAM performances in Table 1 and Table 3 are inconsistent.