- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes to investigate the influence of robustness adaptation strategies, which is an important research topic. The experiments demonstrate that the visual-encoder adaptation with clean-reference alignment provides an effective solution.
Critical strengths
- Evaluating different robustness strategies is important for the reliability of VLA models.
- The authors conduct experiments to investigate the effectiveness of different robustness strategies, providing useful insights into their relative strengths and limitations.
Critical weaknesses
- The abstract does not clearly articulate the key challenges addressed by this work. Furthermore, the connection between these challenges and the claimed contributions is not sufficiently established. The authors should better highlight the limitations of existing approaches and explain how their work addresses them.
- In the introduction, the authors state that “Bringing corrupted visual features closer to their original clean representations may therefore provide a response that remains useful beyond a particular attack objective.” However, this idea is not particularly novel, as reducing discrepancies between clean and adversarial representations is a common objective in adversarial robustness research, including adversarial training. The authors should clarify how their motivation differs from existing approaches and what new insights their work provides.
- The manuscript contains several unclear or logically disconnected statements. For example, the authors write, “Whether this yields better task execution remains an empirical question: a small feature distance alone does not guarantee a successful manipulation trajectory.” However, the latter part of the sentence is a statement rather than a question, and the subsequent discussion does not directly address the empirical question raised. The authors should improve the logical flow and ensure that the questions or challenges introduced are properly addressed in the following discussion.
- For a paper primarily focused on evaluation, a substantial portion of the manuscript is devoted to describing existing adversarial attacks and adaptation strategies. The authors should streamline the descriptions of existing methods and devote more attention to the experimental insights and conclusions drawn from the evaluation.
- The main novelty and contributions of this work are not sufficiently articulated. The paper primarily presents comparisons among existing methods, without clearly identifying the critical findings or novel insights that emerge from these comparisons. A strong evaluation study should go beyond reporting comparative results to reveal meaningful patterns, explain the underlying factors influencing performance, and provide actionable insights for future research.
Questions for authors
Please refer to Critical Weaknesses.