- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper generates language-conditioned motion commands directly in the latent space of a frozen SONIC controller, avoiding explicit kinematic motion generation. It also explores spatial guidance and semantic composition. The idea is practical, and the experiments show good execution stability and competitive motion quality. Overall, I find the results encouraging, though a few aspects deserve further investigation.
Critical strengths
-
This paper generates language-conditioned motion commands directly in the latent space of a frozen SONIC controller, avoiding explicit kinematic motion generation.
-
The idea is practical, and the experiments show good execution stability and competitive motion quality.
Critical weaknesses
-
Why generate continuous latents rather than quantized commands directly? Since SONIC eventually applies FSQ, I wonder whether modeling discrete commands could work equally well, or even better.
-
The model is trained on successful SONIC rollouts, which may already favor stable motions. How much of the improvement comes from this filtering rather than the latent representation itself? A comparison using the same backbone and training data would help.
-
I am not fully convinced that the method reduces the semantic gap. Even ground-truth motions lose R@3 after SONIC execution, and the proposed method does not outperform the strongest baselines in executed R@3. Perhaps the main advantage is stability rather than semantic preservation?
-
The spatial guidance results are somewhat mixed. It improves foot constraints but is worse than Kimodo on hand constraints without IK. Also, the large error increase after IK and physical execution makes me wonder how accurately the kinematic decoder reflects actual controller behavior.
-
The composition results seem weaker than the qualitative examples suggest. Many action pairs largely ignore one attribute. Is score composition really better than simply using a compound text prompt? A direct comparison would be useful.
-
The latent sequence is generated before execution, without high-level feedback. How would the method handle disturbances or unexpected changes in motion timing? Even a simple perturbation test would help clarify its robustness.
Questions for authors
Please see the Weaknesses.