- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes AEGIS, an action-endpoint geometry learning framework for improving VLA robustness. The authors argue that robust VLA policies should preserve their actions under task-irrelevant language and visual changes while responding appropriately to control-relevant changes in robot states, object configurations, and task progress. AEGIS introduces three training objectives based on . BHFM uses bounded heteroscedastic modeling to adjust action prediction residual weights. NEI encourages endpoint agreement under task-equivalent inputs. SEE aligns endpoint displacements between progress-matched states with demonstrated action differences. Experiments on two simulation benchmarks and real-world robot tasks show clear improvements over the baseline.
Critical strengths
- The authors attempt to address two complementary requirements within a unified training framework, namely invariance to task-irrelevant changes and sensitivity to control-relevant changes. The research objective is well motivated. The method does not require changes to the original inference procedure, which is advantageous for practical applications.
- The experimental evaluation is reasonably comprehensive, covering two simulation benchmarks, real-world robot experiments, results across three random seeds for some experiments, and a complete component ablation. The method achieves notable improvements under Camera, Language, and Noise perturbations. These results provide meaningful empirical support for the effectiveness of the proposed method.
Critical weaknesses
-
The authors identify the lack of explicit relational constraints as a key limitation of standard MSE. However, with data augmentation or additional demonstrations under perturbed conditions, accurate per-sample predictions can already satisfy the relationships required by NEI and SEE. Equations (10) and (13) further show that both objectives essentially constrain differences between velocity prediction errors. The paper does not sufficiently establish the specific limitations of MSE or explain why the proposed relational regularizers address them. SEE also treats demonstrated action differences between progress-matched states from different trajectories as state-equivariant displacements. Such differences may reflect different action modes or demonstration biases, and their control relevance is not sufficiently justified.
-
The endpoint estimate is a one-step extrapolation based on the current velocity and does not necessarily equal the final action generated by integrating the full flow ODE. The paper lacks evidence that constraints on extrapolated endpoints reflect the properties of actually generated actions. The MSE-optimal one-step endpoint estimator also has a conditional-mean interpretation. The potential effects of additional endpoint constraints on the multimodal action generation capability of flow-based policies are not discussed.
-
The overall performance improvements are clear, but on LIBERO-Plus, the largest gains come from Camera, Language, and Noise perturbations. The full model does not outperform the baseline under Robot or Layout variations. Adding SEE to BHFM+NEI improves average success by only 0.40 percentage points. The endpoint diagnostics are also closely related to the training objectives and do not sufficiently demonstrate improved state equivariance in actually generated actions.
-
The fairness of the baselines deserves further examination. The paper lacks a standard MSE baseline trained with the same paired data and additional views as AEGIS. BHFM is also not compared with simpler residual-reweighting methods. These missing comparisons make it difficult to attribute the performance improvements to the proposed objectives.
-
Figures 1 and 2 are overly crowded, with some text, labels, and axes difficult to read. Some annotations and formatting also appear unusual, raising concerns about whether generative AI tools may have been used in figure preparation beyond what is disclosed in the AI Use Statement. I would appreciate clarification from the authors on this point. Additionally, some diagnostic tables are not presented clearly, making it difficult to understand the comparison targets and the conclusions supported by the results.
Questions for authors
-
I recommend that the authors consider PAIR-VLA [1]. This work also discusses selective responses to task-irrelevant and control-relevant changes, although it follows a different technical approach. What broader scientific insight does AEGIS aim to establish? Why is action-endpoint geometry an appropriate framework for this problem rather than simply a combination of three loss functions?
-
Could the authors provide additional evidence showing under what conditions standard MSE fails to learn the relationships required by NEI and SEE, and what specific problems the additional constraints address? Since NEI and SEE can be expressed as constraints on differences between velocity prediction errors, what is their unique contribution beyond standard supervised learning? Why should demonstrated action differences between progress-matched states from different trajectories represent meaningful state-equivariant displacements rather than demonstration biases or pairing errors?
-
What is the mathematical relationship between extrapolated endpoints and the final actions generated by integrating the full flow ODE? Why should constraints on the former effectively influence the latter? Given the conditional-mean interpretation of the MSE-optimal one-step endpoint estimator, could additional endpoint-level constraints introduce a bias toward the mean and reduce the ability of flow-based policies to represent multiple valid action modes? I would appreciate a theoretical explanation or direct empirical evidence.
-
The current results mainly demonstrate nuisance robustness, while SEE provides limited incremental gains. What direct evidence shows that the model responds more appropriately to control-relevant changes, rather than simply reducing prediction differences across inputs? Can improvements in endpoint diagnostics be linked to actual generated actions or closed-loop success rates?
-
Could the authors provide a standard MSE baseline using the same paired data and additional views to isolate the benefits of relational regularization? Could BHFM also be compared with simpler robust regression or residual-reweighting methods?
[1] What to Ignore, What to React: Visually Robust RL Fine-Tuning of VLA Models.