- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes a new method for zero-shot skeleton action recognition. Specifically, it uses a pre-trained text-to-motion (T2M) model to generate diverse skeleton sequences for scalable training. Then, it employs LLMs to generate three types of textual descriptions for cross-modal alignment. Experimental results show that the proposed method achieves competitive performance.
Critical strengths
- The idea of synthesizing skeleton sequences rather than action features, as commonly adopted in prior works, is appreciated.
- The design of composing two-body interactions is interesting.
Critical weaknesses
- The presentation quality of the paper is poor, and the writing is extremely obscure and difficult to follow. There are numerous overly complex and lengthy sentences, and the paragraphs are not well organized, especially in the Introduction section, making it difficult for readers to grasp the motivation and overall storyline. Moreover, many relevant citations are missing in the Related Work section, and several technical details are not clearly explained.
- The experimental setting is unfair compared to prior works, as an additional pre-trained text-to-motion model is incorporated, which has been trained on large-scale action datasets (potentially including unseen actions). Thus, prior knowledge of unseen actions may have been leaked during training, which contradicts the requirements of the standard zero-shot learning setting. Additionally, scaling up the training samples for cross-modal alignment while comparing against prior methods trained with limited samples raises further concerns about fairness.
- The proposed method lacks novelty and meaningful technical contributions. LLM-based semantic description expansion has been widely explored in prior works, and the cross-modal alignment module is directly adopted from FS-VAE without modification. Thus, the proposed method appears to be a combination of existing techniques, and I cannot identify any new insights or substantial technical contributions throughout the paper.
- The experiments are not sufficiently comprehensive or thorough. Tables 1 and 2 lack comparisons with recent SOTA methods published in 2026. Meanwhile, only the NTU series datasets are used for evaluation, without considering the widely adopted PKU-MMD dataset. Additionally, the ablation studies do not evaluate the effectiveness of the generated skeleton sequences. Furthermore, the paper lacks qualitative analyses of the proposed method and provides limited new insights, as most of the findings have already been discussed in prior works.
Questions for authors
- What is the role of the set-level assignment method during inference? It appears to follow a transductive setting rather than the inductive setting typically adopted in standard zero-shot learning.
- In the generalized zero-shot setting, how does the proposed method prevent unseen actions from being incorrectly classified as seen actions? The motivation and technical justification behind Eq. (6) remain unclear, particularly regarding how it addresses this issue.