- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes STAR, a semantic backdoor attack against Vision-Language-Action (VLA) models that aims to generalize across variations in physical trigger objects, including style, color, size, pose, and placement. The effectiveness of STAR is evaluated on LIBERO, MimicGen, and real-world manipulation tasks using the SO-ARM100 robot.
Critical strengths
-
The paper identifies a potential shortcut in existing methods such as BadVLA and FlowHijack, where the model may treat any newly inserted object as a trigger. This highlights an important limitation in category-selective backdoor activation.
-
The paper addresses a realistic threat scenario where attackers have limited control over downstream deployment environments. By introducing semantic category-level triggers, STAR aims to improve attack generalization across diverse object appearances, task contexts, and downstream environments.
Critical weaknesses
W1. Insufficient Evidence for Semantic Generalization and Targeted Attack Effectiveness. The evaluation focuses exclusively on scissors, without demonstrating generalization to other semantic categories or providing separate quantitative results for strictly unseen instances and attribute combinations. The absence of visually similar non-trigger objects further limits the evidence for semantic-level selectivity. More critically, the reported ASR measures task failure rather than whether the model follows the attacker-specified action deviations defined in Section 4.3. A high ASR could therefore reflect arbitrary task disruption rather than successful attacker-directed behavior. These limitations undermine the validity of the evaluation and leave the paper's central claims of semantic generalization and targeted attack effectiveness insufficiently supported.
W2. Limited Methodological Novelty and Insufficiently Controlled Comparisons. STAR primarily combines established techniques, including EOT-based augmentation, matched positive/negative interventions, and supervised fine-tuning. Its optimization objective is essentially a weighted combination of existing losses, while separate objectives are designed for OpenVLA-OFT and π0.5 without a principled unified formulation. Furthermore, the baselines may not receive comparable training data and supervision, and the ablation studies do not isolate the contributions of matched triplets, augmentation, and additional non-trigger supervision. Consequently, the reported improvements could arise from additional training signals rather than the proposed framework itself. Without more rigorous controlled comparisons and a clearer methodological distinction from existing approaches, the paper does not convincingly establish a substantial technical contribution.
Questions for authors
As weaknesses