- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
- This paper proposes Paired Residual Adaptation, which is a lightweight method for improving the robustness of VLAs against visual mislocalization. The key idea is to train a residual network to correct the base policy's action predictions using paired clean and visually perturbed observations of the same physical state.
- The method generates correction targets by computing the difference between clean and perturbed action predictions.
- The authors evaluate PRA on LIBERO-Spatial using several models. However, the method can reduce performance under clean observations, short perturbations, and physical target displacement.
Critical strengths
- Simple and practical approach to VLA robustness. I like the idea of adapting VLAs with a lightweight residual network, without requiring additional expert demonstrations. Also, the method adds minimal inference overhead.
- The authors evaluate PRA with π0.5, π0, and OpenVLA, demonstrating consistent improvements under perturbations. I really appreciate the inclusion of matched-budget ablations.
Critical weaknesses
-
Learning a lightweight residual network to correct a frozen VLA's predicted actions has already been explored in several prior works, including ResVLA and other residual policy learning approaches. While this paper introduces paired clean/perturbed action supervision, it is unclear how the proposed method fundamentally differs from these existing approaches.
-
Limited justification for the visual encoder architecture. The residual network uses a relatively small three-layer CNN trained from scratch on only 2.6k samples. It's unclear whether this architecture can extract sufficiently robust visual representations, especially under distribution shifts. Given the strong pretrained visual encoders such as SigLIP and DINOv2, I wonder whether leveraging pretrained visual features would improve correction accuracy, generalization, and clean-condition performance.
Questions for authors
-
Could the authors compare against a residual model / imitation learning policy trained with standard data augmentation techniques?
-
How does PRA compare with alternative VLA robustness methods? The paper discusses RobustVLA, RoVLA, and Cross-View Action Consistency, but does not provide direct empirical comparisons.
-
Could the authors clarify how PRA differs from existing residual-based VLA methods, particularly ResVLA?
-
Why use a small CNN trained from scratch instead of pretrained visual representations such as SigLIP or DINOv2? Given the limited training data, it would be interesting to see whether frozen pretrained features improve robustness and reduce the clean-performance degradation.
4 comments
Dear Reviewer v8rz,
Thank you for your time and constructive feedback. As the discussion period draws to a close, we would be grateful to know whether the augmentation comparison in our rebuttal addresses your concern or whether any questions remain. If you feel it resolves your concern, we would appreciate your taking this evidence into account when reconsidering your overall assessment.
Thank you again for your time and consideration.
Thank you for your detailed response and additional experiments. I appreciate your efforts to address my concerns and happy to maintain my positive recommendation.
Dear Reviewer V8RZ,
Thank you for considering our response and additional experiments. We appreciate your continued positive recommendation and your constructive suggestions, which helped us strengthen the evaluation. If the additional results have strengthened your confidence in the paper, we would be grateful if you would consider reflecting that in your final rating.
Thank you for your questions and suggestions.
1. Standard data augmentation
Our new Aug-Residual control retains PRA’s CNN, frozen π0.5, record count, and training schedule (§§4.3–5). We replace the 587 spatially perturbed records with brightness, contrast, saturation, blur, and noise augmentations, recompute base actions, and retain clean-policy teachers. Other records are unchanged.
All cells use the same 300 starts across ten LIBERO-Spatial tasks. Base/PRA results are reused (§6.1, Fig. 3; clean: §6.3); Aug-Residual and DINOv2 are new. Durations are scheduled control steps, followed by normal rendering if execution continues.
At 40 steps, PRA gains 16.67 pp over Base and 18.67 pp over Aug-Residual (new comparison; Bonferroni-adjusted paired-bootstrap 97.5% CI: [10.67, 26.33]). This supports targeted spatial supervision over the tested augmentations, not pairing alone. The CI covers initial-state uncertainty under fixed tasks and one training seed.
2. Other robustness methods
RobustVLA updates the π0 action expert and uses VLM LoRA (App. B.1.1); RoVLA trains selected semantic layers and an action generator (§4.1); Cross-View Action Consistency fine-tunes π0.5 with paired-view losses (§4.1).
PRA freezes the entire VLA, including its action head (§§3.1, 4.3; Fig. 2). After target collection, only the external module is trained, without VLA backpropagation or architecture changes. Direct comparisons remain useful but have not been run under our protocol; our controls establish benefits within this frozen-policy setting, not a ranking against these methods.
3. Difference from ResVLA
Restoring observations does not undo actions taken during a disturbance (§3.1; Fig. 1). PRA addresses task completion across this process. Its correction reference comes from clean/perturbed predictions of the same frozen policy at the same physical state and sampling noise (§4.1, Eq. 3), requiring no additional expert action labels or deployment-time clean reference (§3.2).
We appreciate ResVLA’s insightful intent anchoring and residual bridging toward demonstrated actions (§4). PRA instead learns an external correction from paired policy predictions. Three-backbone results support full PRA (§6.1, Fig. 3), not pairing alone (§6.2). Clean and physical-displacement limitations remain (§§6.3–7).
4. CNN versus pretrained features
The CNN predicts corrections from images, state, and base actions with only 0.249M parameters (§4.3). Following your suggestion, we replace it with frozen DINOv2-small CLS features, keeping the VLA unchanged. Both views share an encoder; an MLP combines features, state, and base actions. Training retains 2,601 records and the same schedule (§5).
This new module totals 22.35M parameters, about 90× the CNN, excluding the VLA. Clean success rises from 91.67% to 94.67%, but gains are not uniform. This supports the CNN’s size–performance balance, not general superiority.
We chose DINOv2-small to limit added size; larger variants and SigLIP remain untested. Inputs are 224×224 for DINOv2 versus 64×64 for CNN (§4.3), so this tests a specific frozen-CLS replacement, not pretraining in isolation.