- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This work presents a method for adapting a pre-trained text-to-motion models into a VLA model for humanoid control. First, a pre-trained Kimodo text-to-motion model is augmented with ControlNet adaptor layers to inject additional language and visual inputs into the model. An additional model is introduced to generate hand motions. The ControlNet layers are finetuned with data from various whole-body control tasks. The generated motions are then provided as target motions for a whole-body tracking controller (SONIC), which translates the kinematic motion plan into controls for a humanoid robot (G1). The finding that kinematic motion generation models can be finetuned into an effective VLA model, and the motion generation model seem to offer useful priors for downstream tasks.
While the insight is interesting, the exposition of this submission is rather poor with lots of grammatical errors and confusing sentences. Furthermore, it is difficult to assess the quality of the results without videos to showcase the behaviors of the robots. A more detailed discussion is provided in the following sections.
Critical strengths
This work offers an interesting insight that kinematic motion generation models can be effectively finetuned for whole-body humanoid control, and that the motion generation models provide useful priors for downstream tasks.
The experiments provide fairly good comparisons of the proposed method to previous work.
Critical weaknesses
While the insight that kinematic text-to-motion models can be finetuned into VLA models for humanoid control is quite interesting, the technical novelty seems very limited. The method mainly involves adding controlnet layers to Kimodo and an additional HandNet to control the robot’s hands. A similar controlnet method was also previously used to adapt text-to-motion models in: OmniControl: Control Any Joint at Any Time for Human Motion Generation
The three-stage architecture is not particularly novel, since Kimodo’s architecture already consists of a 2-stage architecture that separates the root and body motions. So the only additional stage introduced in this work is the HandNet.
The lack of videos showing the behaviors of the robot makes it difficult to assess the effectiveness of the proposed model.
The quality of the writing in this submission is quite low, well below the bar that would be expected for ICLR. There are many grammatical errors and confusing sentences littered throughout the paper that make it difficult to understand what the paper is trying to say. Below are just a few of the many examples of such writing issues:
Line 215: “isolate stage optimization” awkward wording
Line 218: “while a token-axis MLP maps the image-token sequence to the future temporal horizon.” Not clear what this means, especially “token-axis MLP”.
Line 223: what is “content-selective visual retrieval”? It’s not explained anywhere what this means.
Line 225: What is “bilateral diffusion head”?
Figure 4: What is “Light brown: observed history” referring to? None of the figures are light brown.
Line 280: this sentence is confusing: “All losses mask padding; hand losses also mask unavailable labels, and transitions require two valid adjacent labels”. What does “all losses mask padding” mean? How does “hand losses” mask unavailable labels? What does it mean for transitions require two valid adjacent labels? What are “adjacent labels”?
Line 307: what is “RTC”?
Line 325: what does “evaluate under SONIC” mean? SONIC is a model, it’s not clear how one evaluates a policy “under” a model.
Line 373: what does “joint-best” mean?
Line 453: The sentence is not grammatically correct. Should be “All ablations are trained on… and evaluated on…”
Major revisions to the writing is necessary.
Questions for authors
Can the authors clarify on the technical innovation of this work? Applying ControlNet to adapt a pre-trained model is not a very significant technical innovation.
Can the authors provide some videos of the behaviors produced by the model?
The experiments in Table 1 and 2 compare mostly to old baselines from 2023. Are there more recent baselines that can act as stronger baselines? For example, Wei et al., was only compared to in the SIMPLE benchmark. Can that method also be applied to HumanoidArena. Furthermore, there are more recent works, such as WholeBodyVLA (Jiang et al., 2026), which could provide more recent baselines to compare to.
Please, clarify the writing confusions listed under “Critical Weaknesses”