- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a continual learning method that uses controlled visual interventions to decompose task updates into environment-sensitive and invariant components. It protects the invariant components during learning to reduce forgetting. Experiments with two VLA backbones on LIBERO and RoboTwin 2.0 evaluate new-task learning, and robustness to visual changes.
Critical strengths
The use of controlled visual interventions to guide selective preservation is well motivated. Ablations comparing different protection strategies support the value of the selected directions, and improved performance under held-out visual changes provides evidence of more robust skill retention.
Critical weaknesses
- The averaging step in Eq. (2) is insufficiently validated. Gradient differences from different manipulation states may point in opposing directions and cancel out, causing the estimated subspace to miss state-dependent environmental sensitivity. The paper does not assess this risk, leaving the reliability of the resulting decomposition unclear.
- Figure 1(B) appears inconsistent with the stated counterfactual construction: the depicted object and robot configurations do not seem identical across the four examples, despite the claim that only environmental appearance changes. Several overly long sentences also make the method harder to follow.
Questions for authors
Have you examined whether counterfactual gradient contrasts also capture directions needed to improve task-relevant skills? For example, a background change may produce gradients that both reduce reliance on the background and improve object localization. What evidence supports leaving these directions unprotected without compromising skill retention?
Summary of Responses to Reviewers
We thank the reviewers for their constructive feedback. Below we summarize the additional experiments and clarifications provided in our responses.
Reviewer 1 (Ce32)
Reviewer 2 (Ufvf)
Reviewer 3 (ycMs)