- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
HoRD studies robust humanoid motion tracking from sparse commands under varying dynamics. The method uses a two-stage teacher–student framework. A teacher is trained with full-state observations, dense motion references, and domain randomization. Its behavior is then distilled into a student that operates on partial observations and sparse future motion targets. Both policies use an HCDR module to encode recent observations and actions for dynamics adaptation. The authors evaluate 873 held-out AMASS motions in Isaac Lab and Genesis, with ablations on domain randomization, history conditioning, and encoder design. Qualitative demonstrations on a Unitree G1 are also provided.
Critical strengths
-
Strong results under cross-simulator transfer. I find the Genesis + DR results particularly convincing. Compared with GMT/ResMimic, HoRD improves success from 78.4% to 84.4%, while reducing global and local position errors from 321 mm to 171 mm and from 184 mm to 108 mm. Evaluating under randomized dynamics in an unseen simulator provides useful evidence beyond performance in the training environment.
-
The ablations show the importance of history conditioning under dynamics changes. Removing HCDR has little effect on success under standard Isaac Lab dynamics, but performance drops considerably under randomized dynamics and in Genesis. The results also show the importance of domain randomization. These comparisons help explain when history conditioning is actually useful.
Critical weaknesses
-
The evaluation lacks uncertainty estimates, and some reported success rates are difficult to reconcile with the stated protocol. Tables 1 and 2 do not clearly report the number of independent training runs or provide uncertainty estimates. This is particularly relevant to the small success-rate differences of 0.9 and 1.0 percentage points in the Isaac Lab settings. Testing 873 motions provides broad coverage, but does not address run-to-run variability. I also could not reconcile the success rates in Table 6 with the stated evaluation counts. Appendix A.5 describes six motions with ten rollouts each. Assuming binary success and equal pooling over 60 rollouts, the reported 81.2% and 80.6% would not follow directly.
-
The encoder comparison does not account for differences in model capacity. Table 3 compares several history encoders under the same input and training settings, but their trainable parameter counts are not reported. Matching the latent width and training budget does not necessarily make the models comparable in capacity. Without this information, it is difficult to judge whether the Q-Former's advantage comes from its architecture or a larger parameter budget.
Questions for authors
-
How many independent training runs and evaluation rollouts were used for Tables 1 and 2? Are uncertainty estimates available, particularly for the smaller performance differences?
-
How exactly were the 81.2% and 80.6% success rates in Table 6 calculated? The stated six motions and ten rollouts per motion do not seem to produce these values under simple binary-success averaging.
-
What are the trainable parameter counts of the encoders compared in Table 3? Were their parameter budgets matched?
Rebuttal by Authors
We thank the reviewer for the constructive feedback and for recognizing our cross-simulator results and the benefits of history conditioning.
Training and evaluation settings. Each method and ablated variant in Tables 1 and 2 was trained using one independent training run. Cross-training-run uncertainty estimates are therefore not available.
Evidence supporting our main conclusions. Our central empirical finding concerns transfer under dynamics and simulator shifts. In Genesis + DR, Table 1 reports 84.4% success for HoRD versus 78.4% for the strongest reported baseline, together with a reduction in Eg-mpjpe from 321 mm to 171 mm. These results show an observed improvement in both task completion and tracking accuracy.
The history ablation provides complementary evidence. Removing HCDR from both policies and retraining leaves nominal Isaac Lab success nearly unchanged, but reduces Genesis success from 86.0% to below 10%, demonstrating the importance of the learned history representation for cross-simulator transfer.
Table 6 was evaluated on the full AMASS evaluation motion set. The reference to “six motions” in Appendix A.5 is a writing error. The six representative motions were used for training and testing the encoder variants in Table 3. Table 6 instead evaluates already-trained policies on the full AMASS evaluation set under the diagnostic conditions, without retraining.
We will correct Appendix A.5, the Table 6 caption, and the accompanying discussion.
Q-Former and LSTM have nearly identical trainable parameter counts, while their observed performance differs substantially. Although the parameter budgets for these five architectures are not exactly the same, most of them are quite close.
All configurations use an eight-step state–action history with 522 dimensions per step and produce a 256-dimensional latent representation. Their configuration-based parameter estimates and Table 3 results are:
The Q-Former–LSTM comparison is particularly informative. Both have approximately 4.35M trainable parameters, yet Q-Former achieves 95.0% versus 21.6% success, a difference of 73.4 percentage points, and reduces Empjpe from 655 to 134 mm. Under these estimates, Q-Former’s advantage over LSTM is not accompanied by a larger parameter budget. This contrast supports the relevance of encoder design beyond total parameter count in the six-motion diagnostic.
We will add the architecture and parameter-estimation details, clarify the capacity differences, and highlight the Q-Former–LSTM comparison when interpreting Table 3.
Together, we hope our detailed responses and the additional experiments have adequately addressed your concerns, and we would be very grateful if you might consider raising your score in light of these updates.