- Rating
- 3(+2)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces BadWAM, a black-box adversarial attack framework targeting World-Action Models.The authors investigate the potential misalignment between action generation and future imagination under adversarial visual perturbations.
Critical strengths
-
This paper investigates adversarial vulnerabilities in the World-Action Model (WAM) paradigm, with a particular focus on the relationship between action generation and future imagination. This provides an interesting perspective on the security of embodied foundation models.
-
The authors conduct experiments on LIBERO and RoboTwin across multiple WAM variants. The results demonstrate that adversarial perturbations can substantially degrade task performance. The additional analyses of attack transferability and perturbation budgets further strengthen the empirical evaluation.
Critical weaknesses
W1. Insufficient Justification and Validation of Imagination-Preserving Attacks.
The central motivation for imagination-preserving attacks remains insufficiently supported. The paper assumes that keeping adversarial future predictions close to clean predictions improves attack stealthiness, yet no imagination-based safety monitor or detection mechanism is evaluated to substantiate this claim. More fundamentally, preserving the predicted future does not establish its correctness. The experiments only measure the distance between clean and adversarial predictions, without verifying their accuracy against actual future states or examining their consistency with the outcomes of adversarial actions. Furthermore, the action-only attack consistently achieves stronger task disruption, while imagination preservation offers no demonstrated practical advantage beyond reducing prediction drift. Consequently, the paper does not convincingly establish that imagination preservation creates a meaningful or practically exploitable vulnerability, substantially weakening its central contribution.
W2. Insufficient Experimental Validation and Limited Methodological Novelty.
The proposed attacks primarily combine established action-deviation objectives, future-prediction regularization, and zeroth-order optimization. However, comparisons are largely restricted to random perturbations and a white-box reference, without stronger black-box attack baselines under matched query budgets. More importantly, the complete absence of physical experiments substantially limits the practical significance of the findings, particularly given the paper's emphasis on vulnerabilities in embodied robotic systems. Although the authors cite potential physical damage as justification, prior studies [1, 2] have demonstrated that physical adversarial attacks on VLA-controlled robots can be evaluated under controlled conditions. Such validation is particularly important for assessing whether the proposed perturbations remain effective under real-world perception, dynamics, and execution uncertainties. Without stronger baseline comparisons or any physical validation, the paper provides insufficient evidence of either a substantial methodological advance or a practically relevant robotic safety threat.
[1] Wang, T., et al. Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics. ICCV, 2025.
[2] Lu, H., et al. When Robots Obey the Patch: Universal Transferable Patch Attacks on Vision-Language-Action Models. CVPR, 2026.
Questions for authors
As weaknesses
7 comments
Response to reviewer 3pWC [2/2]
[W2] Methodological contribution and stronger baselines. Physical experiments and deployment scope.
A2: Thanks for the valuable comment. We provide the following clarifications and additional experimental results:
- We additionally evaluated existing VLA attacks (the attacks are from the two papers that reviewer 3pWC mentioned in the review) on LIBERO:
| Attack | Task Success Rate$\downarrow$ |
|---|---|
| UADA [1] | 94.6% |
| TMA [1] | 95.1% |
| UPA [1] | 98.8% |
| UPA-RFAS [2] | 98.3% |
| BadWAM (ours, action-only) | 61.5% |
| BadWAM (ours, img-preserving) | 63.0% |
As can be observed, the transferred VLA attacks retain 94.6–98.8% target task success, whereas the action-only and imagination-preserving BadWAM objectives reduce success to 61.5% and 63.0%, respectively. This comparison suggests that attacks developed for conventional VLA policies do not automatically exploit the WAM action–imagination interface.
-
Thanks for pointing us to the two relevant physical VLA studies [1,2]. They focus on persistent physical patches for VLA systems, and we fully agree that real-robot evaluation would broaden the practical contribution of our work. However, we currently do not have access to a physical robot arm or the associated camera required for real-robot experiments. We will therefore clarify the scope of our conclusions, and discuss the related physical studies. We'll add the following discussions in the revision:
-
Our current experiments establish the vulnerability through controlled closed-loop simulation. Simulation-only robotic attacks have also appeared in recent top-venue studies, including DP-Attacker [3] and BadVLA [4].
-
Given BadWAM’s original and novel formulation of the attack surface and its comprehensive evaluation across benchmarks and WAM variants, we sincerely hope that reviewer 3pWC could reconsider the overall assessment in light of these clarifications and additional results.
-
[1] Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics. ICCV 2025.
[2] When Robots Obey the Patch: Universal Transferable Patch Attacks on Vision-Language-Action Models. CVPR 2026.
[3] Diffusion Policy Attacker: Crafting Adversarial Attacks for Diffusion-based Policies. NeurIPS 2024.
[4] BadVLA: Towards Backdoor Attacks on Vision-Language-Action Models via Objective-Decoupled Optimization. NeurIPS 2025.
Thanks again for the constructive feedback. If reviewer 3pWC has any remaining concerns, we are happy to clarify further.
Dear Reviewer 3pWC,
We are grateful for the care and thought you have put into reviewing our work. We hope our rebuttal has offered helpful clarification regarding your concerns. If there are any aspects we could explain more clearly, we would sincerely appreciate the opportunity to do so.
Your kind consideration and the time you have generously given to our work mean a great deal to us.
Best regards,
Authors of Submission 5001
Response to reviewer 3pWC [1/2]
It’s our great honor to receive Reviewer 3pWC's thoughtful comments and kind words to our work. We would like to address the concerns as below.
A1: Thanks for the valuable comment. We added two analyses to distinguish future-output preservation from prediction correctness.
Imagination preservation reduces future distance by 0.979 and action distance by 0.035, while increasing task success by 4.4.
Compared with action-only, imagination preservation increases prediction-to-realization SSIM from 0.812 to 0.831, reduces output detection from 27.5% to 7.5%, and increases the fraction of failed episodes escaping output detection from 62.5% to 86.7%. Consistency detection remains comparable (72.5% versus 70.0%). These results establish the practical role of the preservation objective: it makes attack-induced failures substantially less visible from the predicted output while improving prediction-to-realization alignment. We will revise the paper to distinguish this measured property from the stronger claim that the predicted future is semantically correct.