- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Test-Time Command Optimization (TTCO) to improve motion-tracking accuracy of pretrained humanoid Behavior Foundation Models (BFMs) without retraining. By optimizing motion commands through simulation-based rollouts using sample-based methods, TTCO reduces tracking errors. The paper further studies compute-optimal allocation and applies TTCO to generate action labels for downstream loco-manipulation and cross-BFM demonstration reuse.
Critical strengths
- The paper tries to address a practical and important problem, formalizes it, and proposes a test-time optimization method rather than training a stronger BFM.
- TTCO reduces mean global body-position errors by 79–84% across three BFMs on 12,273 AMASS motions, demonstrating strong effectiveness and generality.
Critical weaknesses
- The method introduces additional computational cost at test time, which raises concerns about real-time inference.
Questions for authors
- Is the computational cost of test-time optimization acceptable in practice? Could the authors report per-planning-step latency and analyze the trade-off between wall-clock runtime and tracking performance under different compute budgets?
- Can the optimized data be used to directly reduce the BFM's tracking errors? For example, could the authors collect (command, action) pairs and finetune the BFM using behavior cloning (BC)?
- Does the method require additional steps when the robot interacts with objects?
- Table 1 shows increased joint acceleration after optimization, and the authors acknowledge potential motion jitter. Could the authors provide a quantitative analysis of command discontinuities and execution stability, particularly at replanning boundaries? How can such instability be mitigated?