- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work investigates how to improve fall recovery for a physics-based humanoid controller. The authors propose gathering rollouts from a pre-trained general motion tracker during severe disturbances that meet a “failure” threshold. This dataset is then used during training to reset environments, and a phase-aware reward is used to balance recovery and tracking objectives. The authors show
Summarized contributions:
- Fall Dataset
- Kinematic Prior History Injection
- Phase-aware reward scheme combining recovery incentives and reference tracking
Critical strengths
-
The idea of using a dataset of dangerous states is simple.
-
The phase-aware reward scheduling is intuitive.
Critical weaknesses
-
The submission has no supplementary video. This is crucial, as it makes it difficult to assess the dataset quality and the recovery policy. The screenshots are hard to judge because they are often miscropped and distorted.
-
It is unclear why a history reconstruction (Eq. (2)) is necessary if all the previous states are recorded exactly. See question 1.
-
The limitations section is insufficient and only mentions idealized sensing, which is not necessarily a limitation of the method itself. One limitation is the required pre-trained policy to collect rollouts.
-
The phase-aware reward is a very simple heuristic. Work on balancing rewards exists, e.g., [1, 2]; however, the authors do not sufficiently contextualize or investigate this contribution within the existing literature.
-
The Evaluation is minimal. The paper misses comparisons to any other recovery method. Evaluations contain ablations and comparisons against PHC.
Questions for authors
-
The Fall Dataset contains the exact states (positions and velocities) of the look-back window. So why is a "history construction" even necessary when the actual velocities are collected?
-
Typically, the reason the history is not properly reset is due to unknown quantities from the policy, such as past actions. This can be important information for the policy to learn regularization better, especially in real-world robot applications. How would your method deal with such a setup?
-
The Fall Dataset is currently biased towards behavior resulting from a pre-trained controller. This is a) a costly process; you must first train a complete controller, and b) it limits general fall behavior. Can we not collect a dataset from random policies, or directly from poses?
-
The phase coefficient for the reward formulation assumes a recovered state is at a certain height. If the dataset includes ground motions, we might also want to successfully track those; does this formulation still work?