- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
TAPDreamer constructs a fixed adversarial patch using six observations and a public visual encoder, without querying the target policy. The paper reports substantial degradation across WAM-controlled manipulation tasks and investigates attention-mediated perturbation propagation.
Critical strengths
1.Strong closed-loop attack results across two benchmarks and multiple downstream architectures.
2.Matched random-patch controls demonstrate that optimized patch content causes substantially greater degradation than random pixel replacement.
3.Attention-restoration experiments provide useful mechanistic evidence beyond qualitative visualizations.
Critical weaknesses
1.Sensitive to patch position limit physical deployability. The attack requires persistent patch injection at fixed image coordinates. However, a scene-placed physical patch would undergo translation, scaling, and viewpoint changes during robot execution. Table 5 shows that relocating the unchanged patch largely eliminates its effectiveness, while robustness to smaller geometric transformations is not evaluated. Consequently, the strong digital attack results do not establish practical effectiveness against physically deployed robotic systems.
2.Incomplete statistical reporting. The meaning of “±0.00,” independent repeat counts, seed configurations, and sampling structure of the 48 mechanism-analysis states are insufficiently specified. (Tab.1 / Tab. 2)
3.Unclear dependence of transferability on encoder sharing. The experiments demonstrate transfer across downstream control architectures, but do not clearly distinguish this from transfer across visual encoders. Without specifying which models share identical encoder weights, the generality of the cross-model transfer claim remains difficult to assess.
4.Incomplete causal validation of the proposed mechanism. Attention-restoration experiments support the role of attention in perturbation propagation. However, they neither isolate the contribution of the attention-weight/value interaction term nor establish whether reducing latent and action differences restores closed-loop task success. The connection between the proposed mechanism and task failure therefore remains only partially validated.
Questions for authors
1.Do the authors plan to conduct real-world experiments to evaluate whether the frozen patch remains effective under changes in position, scale, and viewpoint during robot execution?
2.What does “±0.00” represent, how many independent runs and seeds were used, and how were the 48 mechanism-analysis states sampled across tasks and episodes?
3.Which evaluated models share identical visual encoder weights, and does the patch transfer to models with different visual encoders?
4.Can additional interventions isolate the attention-weight/value interaction term’s contribution, and does restoring attention components recover closed-loop task success?
Thank you for the detailed rebuttal and additional experiments. I appreciate the authors' efforts in addressing my concerns. However, some concerns remain.
Robustness to spatial transformations. The additional experiments primarily evaluate fixed pixel-level translations at a single input resolution. However, the same pixel-level shift can correspond to different relative displacements across image resolutions. Moreover, in real-world scenarios, the apparent size, position, and perspective of the patch may vary significantly due to changes in camera distance and viewpoint. Therefore, the current experiments do not fully demonstrate robustness to realistic spatial transformations.
Methodological novelty. My primary concern regarding methodological novelty remains. The proposed approach appears to be a relatively straightforward adaptation of existing feature-space adversarial attack methods to the WAM setting, without introducing substantial new technical innovations. While the empirical results and mechanistic analyses are valuable, I remain unconvinced that extending existing techniques to a new model family constitutes a sufficiently novel methodological contribution.
Overall, although the rebuttal strengthens the empirical evaluation, it does not fully address my concerns, particularly regarding methodological novelty. After reconsidering the paper's contributions, I have decided to lower my score.