- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes SWAM, a world-action model that uses asymmetric visual denoising to learn representations for robot control. An attention-isolated auxiliary branch denoises corrupted current observations using shared visual weights, while the future branch is trained with noise concentrated near the pure-noise endpoint. At deployment, the visual backbone processes the current observation and noisy future slots once, and the resulting features are cached for iterative action denoising. Evaluations on LIBERO, LIBERO-Plus, RoboTwin 2.0, and four real-robot tasks show improvements over Fast-WAM, with inference latency close to Fast-WAM and substantially lower than Fast-WAM-Joint.
Critical strengths
1.Substantial empirical improvements on a practically relevant robustness problem. SWAM achieves 83.40% on LIBERO-Plus, compared with 51.50% for Fast-WAM and 68.39% for Fast-WAM-Joint, while maintaining strong standard-LIBERO performance. The real-robot experiments also show an improvement from 59.0% to 76.5% over Fast-WAM across four tasks. These results provide useful evidence that the proposed training recipe improves performance beyond the original training distribution.
2.A coherent design supported by relevant component analyses. Distinguishing available current observations from unavailable future observations is a reasonable motivation for different denoising conditions. The auxiliary current branch updates shared visual weights without adding deployment-time computation. The reported ablations examine current-observation supervision, future-noise sampling, and access to future-position features. In particular, the improvement from 77.18% to 83.40% when adding current-observation denoising supports the usefulness of this auxiliary objective.
Critical weaknesses
1.The methodological contribution appears incremental relative to closely related work, and the most relevant comparisons are missing. Single-pass construction of future-conditioned features and their reuse during action denoising are already central to ForeWAM, Faster-WAM, and RIFT. Likewise, treating denoising as representation learning has established precedents in Deconstructing Denoising Diffusion Models for Self-Supervised Learning and DiffMAE. SWAM acknowledges these connections, but its main experiments do not compare against the closest single-pass WAM methods. The distinctive contribution therefore appears to lie primarily in the particular combination of auxiliary current denoising, future-noise sampling, and loss weighting. Stronger evidence is needed to establish the value of this combination beyond existing future-feature interfaces.
2.The experiments do not fully isolate the proposed asymmetry or establish the stability and generality of its benefits. The ablations are useful, but multiple factors change relative to Fast-WAM: access to future features, future-loss weighting, future-noise sampling, and current-observation supervision. Notably, Figure 4 reports a 5.48-point gain from changing future-loss weighting, whereas changing the sampling distribution from Uniform to Beta(7,1) adds 1.57 points under uniform weighting. This suggests that the contribution of the proposed noise asymmetry should be distinguished more carefully from other training changes. Matched comparisons between symmetric and asymmetric noise assignments, with auxiliary supervision and loss scaling controlled, would strengthen the interpretation. Moreover, the main results lack variability estimates across independent training runs. The robustness claim should also be qualified: RoboTwin randomized success improves over Fast-WAM but remains only 15.2%, below several other reported methods.
Questions for authors
1.How does SWAM compare with ForeWAM, Faster-WAM, or RIFT under matched backbone, training-data, optimization-budget, and evaluation conditions? What benefit can be attributed specifically to the asymmetric denoising recipe beyond the shared single-pass future-conditioning interface?
2.Can you isolate the effects of noise sampling and loss weighting while keeping the architecture and auxiliary objectives fixed? In particular, how do symmetric noise assignments compare with the proposed asymmetric assignment under controlled loss scaling?
3.In the future-feature readout diagnostic reporting 77.18% versus 62.14%, was the model without future access retrained under the corresponding attention restriction, or was access removed only at evaluation? This distinction affects whether the result establishes a training benefit or sensitivity to an inference-time intervention.
4.How reproducible are the main improvements across independent training seeds? Do the contributions of current denoising and future-noise scheduling remain consistent on RoboTwin or the real-robot tasks, beyond the LIBERO-Plus ablations?