- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This manuscript focuses on motion primitive analysis. The underlying assumption is that complex motions can be understood as sequences of primitive motions. The paper asks how to determine when two motions should be regarded as the same primitive. It proposes to analyze input motion along two dimensions, identity and execution, in order to obtain primitives. The authors report that fixed-length segmentation is not effective and that reconstruction-based models, even with semantic constraints, do not perform these tasks well.
Critical strengths
The attempt to analyze motion and extract reusable primitives is valuable. It may benefit motion composition and phase analysis.
Critical weaknesses
From the abstract and introduction, I cannot identify the focus of the manuscript. Is it about the reusability of end-effector motions for robotic arms, humanoid robotic motion, or human motion analysis? The paper appears to pursue a fundamental innovation, but it still needs an application scenario. For example, when contrastive learning was proposed, it was still validated on image classification. After reading the abstract and introduction, I honestly do not know what the paper is doing.
At the methodological level, the paper only describes conceptual content. There is no concrete implementation. There is no specific application or implementation. After reading it, I do not know how the method is implemented. This is a clear characteristic of auto research/ARIS: it is full of high-level ideas and lacks low-level implementation. It is all concepts, with no explanation of how to implement them.
I understand the authors may argue that the paper contains implementation details, such as details of the network structures and the training data. They may argue that they provide the number of network layers, the amount of training and testing data, and how augmentation is performed. However, an ordinary researcher would find this strange. The paper mentions the use of GRU and Transformer structures. Given that different tasks may require modifications to the model, Table 2 does not reflect this. It is full of generic content and even contains arrows, which is an unusual and AI-like form of expression. I also cannot determine where the experimental data comes from. It is not related to motion datasets I am familiar with, such as AIST++, AMASS, or HumanML3D.
There are no existing works used for comparison. This is not consistent with standard academic practice. If this is the first pioneering work and no existing work has addressed the same problem, or if existing works have different objectives, the authors should at least adapt existing peer-reviewed published works to the objective of this paper for comparison.
From the experimental results, the representation in the qualitative results is also unusual. I do not think anyone would draw figures in this way. All these signs, including the high-level description, the unreasonable experiments, and the experimental result figures that do not look human-made, indicate that this is a clear rejection.
Questions for authors
See "Critical Weaknesses".
2 comments
Q4: About the real datasets and external comparisons.
A4: Thank you for raising these concerns. We address the real-data evaluation and comparison design below.
Real-motion evaluation. We conducted additional experiments on HDM05 [1], using its public normalized 3D skeleton release. We selected forward and backward rotations of the left and right arms, together with squats, for basic-motion evaluation, and composed recorded arm-motion segments into primitives containing 2–4 basic motions. We evaluated cross-execution retrieval, execution exchange, ordered-structure readout, and recovery in longer trajectories on held-out recordings, with Sem-AE and Sem-Factor adapted to the same motion interface. The table below reports the results of seed 0 and 1.
| Method | Retrieval (R@1) ↑ | Retrieval (mAP) ↑ | Execution exchange (nRMSE) ↓ | Ordered-structure (exact recovery) ↑ | Long-sequence (joint recall) ↑ |
|---|---|---|---|---|---|
| OURS | 1.000 / 1.000 | 1.000 / 1.000 | 0.2202 / 0.2214 | 1.000 / 1.000 | 1.000 / 1.000 |
| Sem-AE | 0.738 / 0.744 | 0.529 / 0.537 | 0.4240 / 0.4212 | 0.369 / 0.375 | 0.796 / 0.737 |
| Sem-Factor | 0.774 / 0.720 | 0.662 / 0.586 | 0.3736 / 0.4129 | 0.452 / 0.327 | 0.639 / 0.514 |
These results support the intended structure representation and execution responsibilities on recorded human motion: our model recognizes the same primitive across different executions, its learned structural representation preserves motion geometry and constituent order, and the execution retains execution-specific variation.
Purpose and scope of comparisons. Our experiments are designed to test the feasibility of the proposed formulation and whether structure and execution fulfill their respective responsibilities. The fixed-chunk comparison tests alignment with variable primitive boundaries. The representation comparisons test whether structure preserves motion geometry and ordered composition while execution retains realization variations. Sem-AE and Sem-Factor examine whether reconstruction with primitive-level semantic shaping, including a separate supervised execution latent, suffices to meet these requirements. These comparisons assess the value of explicitly assigning different responsibilities to structure and execution, rather than establish a general ranking on a downstream task.
Direct numerical comparisons with existing primitive methods, such as EMMP[2] and VLBiMan[3], are difficult because their primitive definitions and required task interfaces differ from ours. EMMP models task-conditioned trajectory manifolds under specified task symmetries, while VLBiMan reuses object-anchored manipulation modules through vision-language grounding. Our primitive identity is defined by the ordered composition of actors and canonical motion geometries across execution variations. An aligned comparison would require task parameters and symmetry actions for EMMP, and task text, visual object/grasp information, and robot kinematics for VLBiMan. These interfaces are absent from our trajectory benchmarks, so adapting these methods would require a common task and supervision protocol.
[1] Meinard Müller, Tido Röder, Michael Clausen, Bernhard Eberhardt, Björn Krüger, and Andreas Weber. Documentation: Mocap Database HDM05. Technical Report CG-2007-2, Universität Bonn, 2007.
[2] B. Lee, Y. Lee, S. Kim, M. Son, and F. C. Park, "Equivariant motion manifold primitives," in Proceedings of the 7th Conference on Robot Learning (CoRL), vol. 229, 2023, pp. 1199–1221.
[3] H. Zhou and K. Jia, "VLBiMan: Vision-language anchored one-shot demonstration enables generalizable bimanual robotic manipulation," in International Conference on Learning Representations (ICLR), 2026.
We sincerely thank the reviewer for the careful review. We address the reviewer’s concerns point by point, and we hope that our clarifications below address the reviewer’s concerns.
Q1: About the focus of the manuscript.
A1: Thank you for raising these concerns. Our long-term goal is to use reusable motion primitives as units for motor planning in complex action-sequence tasks. A prerequisite is to specify what makes a primitive the same unit across different executions. This motivates the central question of this paper: when should trajectories with different executions be regarded as instances of the same primitive?
We address this question by representing each primitive instance in terms of structure and execution. Structure defines primitive identity through the ordered composition of canonical basic motions, including their geometry and associated actors; execution describes how that structure is realized. Under this definition, trajectories instantiate the same primitive when they preserve this ordered structure despite changes in execution.
Building on this definition, we seek to represent each primitive in a form that subsequent motor planning can use. The learned structural representation should therefore preserve the constituent motion geometry and order while remaining stable across the specified execution variations. The separately estimated execution factors should describe how these motions are realized through amplitude, duration, and relative rhythm. The focus of this paper is to establish these representation responsibilities, with the representations serving as an intended interface for subsequent motor planning.
Q2: About the concrete implementation and application
A2: Thank you for raising these concerns. We describe the concrete method in Sec. 3.2 and provide the step-by-step training, inference, and longer-trajectory recovery procedures in Algorithms 1–3, with architecture and training details in the appendix. If any implementation step remains unclear, we would appreciate the reviewer identifying it so that we can provide a more detailed explanation.
The intended applications follow from our central question and the complementary responsibilities of structure and execution. The learned structural representation should preserve motion geometry and constituent order across execution variations, while the execution factors capture how each instance is realized. This separation supports recognizing different executions as instances of the same primitive. By retaining the primitive’s motion content and ordered composition, the structural representation is also intended to serve as an interface for subsequent motor planning, with execution specified separately.
Q3: About the claim of auto research.
A3: We would like to clarify that this work was not conducted through autonomous research. We formulated the research questions, made the methodological and experimental decisions, and interpreted the results. We used AI tools for assistance, as disclosed in our AI Use Statement, and reviewed and validated their outputs.