- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents HuGe, a training framework for humanoid VLA policies built on three existing VLA architectures. The main contribution is a three-stage training recipe consisting of large-scale egocentric pretraining, humanoid adaptation, and downstream task fine-tuning. The paper additionally introduces simulation-derived pseudo-proprioceptive states for egocentric data and visual adaptation that replaces human arms and hands with rendered robot counterparts. The training corpus exceeds 2,000 hours. HuGe obtains strong results on HumanoidArena and shows that egocentric demonstrations can improve a real-world Unitree G1 pick-and-drop task.
Critical strengths
The paper provides a useful scaling study across three VLA families rather than relying on a single architecture. This gives the central result broader relevance and suggests that the benefit of egocentric pretraining is not tied to one particular model design. The empirical analysis is also fairly comprehensive at the training-recipe level. The paper studies full fine-tuning, pseudo-proprioception, pretraining scale, data composition, and visual adaptation, and includes both simulation and physical-robot experiments.
Critical weaknesses
The main concern is that the reported benchmark improvements are not cleanly separated from data and compute scale. HuGe benefits from a very large additional training corpus and a dedicated humanoid adaptation stage, while several baseline results are taken from the original HumanoidArena evaluation. The current results establish strong performance, but do not fully identify how much of the gain is due to the proposed transfer recipe rather than substantially greater pretraining. The real-world validation is narrow relative to the generalist framing. The physical evaluation consists of a single pick-and-drop task with a largely fixed task structure. Although it requires locomotion and manipulation, it does not demonstrate broad task composition, semantic variation, or transfer across substantially different humanoid skills. In addition, the improvement attributed specifically to visual adaptation is from 18/30 to 20/30 successes, which is too small to interpret confidently without uncertainty estimates.
Questions for authors
- Can the authors provide a data- and compute-matched control using the same backbone and approximately the same optimization budget, but without the proposed egocentric pretraining recipe? This would help separate the effect of the method from the effect of scale.
- For the real-world experiment, can the authors report confidence intervals or an appropriate statistical comparison for the 13/30, 18/30, and 20/30 success rates? In particular, the evidence for the additional benefit of visual adaptation is currently limited.
- In the pretraining scaling experiment, are optimization steps and total sample exposure controlled when moving from 10% to 100% of the egocentric dataset? If not, the result may conflate data scaling with additional optimization.
- Pseudo-proprioception improves the GR00T and Pi variants but degrades the OFT variant. Can the authors test whether this is primarily caused by textual state serialization and truncation rather than by pseudo-proprioception itself?