- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper provides a method to attack world-action models via constructing a perturbation targeting the geometric relationship between the action- and state-relevant directions in the world model's representation. The approach, CAGE, constructs proxy objectives to provide a differentiable target for projected gradient descent attacks on the model. The paper conducts experiments applying CAGE attacks to simulated and real-world robots.
Critical strengths
- Empirically, the paper is strong. The experiments on both simulated and real world robotics applications demonstrate the value and applicability of the method clearly.
- The paper also diligently provides suggested defenses against the proposed attack with some analysis.
Critical weaknesses
- The justification for critical parts of the method are not clearly articulated, making it difficult to understand why the proposed method is designed as such, and how it differs from prior work. For example, it is unclear why constraining the causal discrepancy in Equations 6 and 7 is necessary, and what it is meant to achieve. It is also unclear why the environment rollouts affect the differentiability of the attack; so long as the environment dynamics distribution is not changing and are not themselves dependent on the policy, this should remain tractable.
- Prior work is not appropriately engaged with; the related works section reads like a list of papers with no verbiage distinguishing the proposed work from prior work.
- Additionally, the methodological section is imprecise with missing definitions and inconsistent notation. For example, Obs() and Rollout() are not defined or introduced. Additionally, and both refer to observations, while additionally refers to representations.
Questions for authors
Could the authors expand on why the environment rollout affects differentiability, for instance what inputs to the environment transition function are that are not differentiable w.r.t the model?