- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The authors propose HERA, an efficient fine-tuning framework for flow-based vision-language-action models, aiming to improve learning efficiency by dynamically allocating training supervision resources. The core idea of this method is to allocate supervision at two interrelated granularities. At the action-chunk level, it adjusts the visitation frequencies of different training samples through dynamic sampling, and at the action-subspace level, it assigns different loss weights to the native physical action subspaces of each action chunk according to current learning needs. To coordinate these two decisions, the authors further design a trajectory-guided training response estimator that combines physical action correspondences with the current learning state of the model, uses a small number of calibration responses to predict the effects of different supervision signals on fixed training-side reference targets, and jointly optimizes the sampling distribution and subspace weights through periodic updates. Experimental results show that HERA achieves a higher average task success rate under the same number of optimization steps.
Critical strengths
This paper focuses on the important practical problem of improving VLA fine-tuning efficiency and takes a novel perspective: the learning utility of action chunks and their internal action subspaces evolves dynamically with training. Building on this perspective, the authors propose a hierarchical response-aware supervision allocation framework that dynamically and jointly adjusts the sampling frequencies of sample chunks and the supervision weights of subspaces according to the model's current learning state. Compared with the conventional practice of treating all expert demonstrations and action dimensions uniformly, this design establishes a more scientific and efficient training resource allocation mechanism. The substantial improvements in training efficiency demonstrated in the experiments strongly support the practical value of this approach.
Critical weaknesses
None
Questions for authors
1.Although HERA demonstrates promising performance on LIBERO-Long, its real-world evaluation is limited to four simple tabletop manipulation tasks. It remains unclear whether the proposed method remain effective in more challenging long-horizon tasks involving multi-stage task execution, contact-rich interactions, and accumulated execution errors. We encourage the authors to provide more empirical results to demonstrate the effectiveness of HERA on more complex multi-stage real-world manipulation tasks.
2.The simulation experiments are conducted only on LIBERO. Although the results show consistent performance improvements across its four task suites, it remains unclear whether these gains generalize to other simulation benchmarks with different task distributions, environment settings, and manipulation challenges. We encourage the authors to supplement the evaluation with experiments on other robotic manipulation benchmarks (RoboCasa or DROID) to examine the generalization ability and robustness of HERA.