- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes TARA, a physical adversarial attack method for world models and video understanding models. TARA combines trajectory-aware optimization, contrastive alignment, and task refinement to make a single adversarial texture effective across different videos, viewpoints, and object-camera trajectories. The authors conduct experiments on EK100, SSV2, and real-world print-and-recapture data, demonstrating the effectiveness of TARA on action recognition, future action anticipation, and future frame generation tasks.
Critical strengths
- The paper studies physical adversarial attacks in dynamic environments, which is a meaningful and practical problem. The use of trajectory-aware optimization provides a certain degree of novelty.
- The experiments are comprehensive, covering multiple models, tasks, and datasets, including real-world physical attack experiments.
Critical weaknesses
- The texture attachment regions are manually selected. It is unclear whether different attachment locations would significantly affect the attack performance.
- The real-world physical evaluation is still somewhat limited. Compared with EOT, TARA shows relatively modest improvements, and the physical print-and-recapture experiments are conducted on only a subset of the evaluated models.
Questions for authors
- How exactly are the texture attachment regions selected? Would changing the attachment locations significantly affect the attack performance?
- Why do all experiments use circular adversarial textures? Would the proposed method remain effective with square or other texture shapes?
- Are the improvements of TARA over EOT in the real-world physical experiments statistically significant? Could the authors provide more evidence of the stability of these improvements?
4 comments
Response regarding to Weakness 2 and Q3
Q3. The real-world physical evaluation is still somewhat limited. Compared with EOT, TARA shows relatively modest improvements, and the physical print-and-recapture experiments are conducted on only a subset of the evaluated models. Could the authors provide more evidence of the stability of these improvements?
Thank you for your feedback; please find our response below.
We conduct additional print-and-recapture experiments on V-JEPA2-L for action anticipation and recognition, and InternVideo2 for action recognition to further evaluate the effectiveness of TARA in physical settings. We also include PhyCamo as an additional competitive baseline. For each model-task setting, we select 100 action events and record four video clips per event: one reference clip with a white texture and three attacked clips with printed textures generated by TARA, EOT, and PhyCamo, respectively, yielding a total of 1,200 video clips across the three settings. For each event, all printed textures are placed at the same scene location, and the same action is repeated under consistent recording conditions to ensure a fair comparison.
Table: Additional physical print-and-recapture results. We evaluate 100 events per model-task setting and report Top-1 ASR (%), computed over events correctly classified on white reference clips.
\hline \text{Tasks} & \text{Anticipation} & \text{Recognition} & \text{Recognition} & \text{Overall} \\\\ \text{Models} & \text{V-JEPA2-L} & \text{V-JEPA2-L} & \text{InternVideo2} & \\\\ \hline \text{Physical EOT} & 35.8 & 20.8 & 32.3 & 29.6 \\\\ \text{Physical PhyCamo} & 30.2 & 25.0 & 32.3 & 29.2 \\\\ \hline \mathbf{Physical\\ TARA} & \mathbf{45.3} & \mathbf{31.3} & \mathbf{41.5} & \mathbf{39.4} \\\\ \hline \end{array}$$ As shown in the above Table. TARA consistently achieves the highest Top-1 ASR across all three settings. Overall, TARA improves averaged ASR over EOT and PhyCamo by **9.7 and 10.2 percentage points**, respectively. These results further support the effectiveness of TARA in physical settings, with consistent improvements across the evaluated models and tasks. **We thank the reviewer for the constructive feedback, and we have added those results and discussion in Appendix, A.3, page 15-16 of our uploaded revised manuscript.**Thanks for the detailed response. The authors have addressed all my concerns. I will raise my score and recommend acceptance.
We sincerely thank the reviewer for the positive assessment and constructive feedback throughout the review process. We are especially grateful for your willingness to raise the score and recommend acceptance.
Response regarding to Weakness 1, Q1, and Q2
Thank you for the constructive question. We clarify the selection criteria and provide additional experiments to examine the influence of attachment location on attack performance.
1. Texture attachment selection. The initial attachment regions are manually selected based on physical feasibility, requiring an approximately planar surface with sufficient space to accommodate the circular texture (Sec. 3.2).
2. Effect of the attachment location. To investigate the effect of attachment location on attack performance, we selected 74 annotated EK100 clips that are correctly classified by the V-JEPA2-L. In addition to their original texture locations, we manually select two alternative attachment locations for each clip, which have a mean center displacement of 32.1±30.3 pixels from the original locations. For each alternative location, we re-track the selected region to estimate the corresponding homographies and visibility matrices across frames. We evaluate three adversarial textures, optimized by TARA, EOT, and PhyCamo, along the new locations without location-specific re-optimization. Across the three attachment locations, TARA achieves an average Top-1 ASR of 38.7±1.6%, compared with 32.4±0.0% for EOT and 18.5±1.6% for PhyCamo. These results suggest that attachment location variations have limited impact on attack performance, and the optimized texture remains robust to location changes. We thank the reviewer for the constructive feedback, and we have added these results and discussion in Appendix A.6, page 18 of our uploaded revised manuscript.
Thank you for your feedback; please find our response below.
1. Motivation for using circular adversarial textures. We initially adopted circular textures as an empirical design choice motivated by their rotational symmetry. As the viewing angle changes along a trajectory, the circular shape remains invariant to in-plane rotations, reducing shape-induced orientation dependence. To further investigate the influence of texture shape, we conduct additional experiments using square textures under comparable experimental conditions.
2. Performance with square textures. We replace the original 48×48 circular texture with a 42×42 square texture to maintain a comparable texture area. The square covers 1,764 pixels, closely matching the 1,810 pixels covered by the circular texture. We maintain the same texture center and reuse the recorded trajectories and homographies, keeping the same texture placement and motion consistent across both shapes. We evaluate EOT, PhyCamo, and TARA using square textures on V-JEPA2-L and AVT-B for EK100, and V-JEPA2-L and VideoMAE-B for SSV2. The results are shown in the table below.
Table. Comparison of circular and square textures on EK100 action anticipation and SSV2 action recognition. Top-1 ASR (%, ↑) is reported. Each entry denotes Train/Val.
Overall, square textures achieve comparable attack performance to circular textures, with a slight average ASR drop of approximately 1–3 percentage points across the evaluated methods. These findings suggest the feasibility of exploring alternative texture shapes within the proposed attack framework.
We thank the reviewer for the constructive feedback, and we have added these results and discussion in Appendix A.5, pages 17-18 of our uploaded revised manuscript.**