- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies zero-shot skeleton action recognition. It argues that generating descriptions with an LLM and encoding them with CLIP makes prototypes depend on sampling and on the encoder. MotionProbe instead reads final-token hidden states of a frozen Qwen3-4B under six fixed prompts, maps them into the skeleton space with an MLP, and calibrates them on the unlabeled test set via Sinkhorn assignment. Results are on NTU-60/120 and PKU-MMD.
Critical strengths
The diagnosis of the generate-then-encode pipeline is cleanly controlled. Regenerating descriptions from the same prompt changes Flora's accuracy by up to 8.70 and 11.61 points on the two NTU-60 splits (Appendix B), and Table 5 changes only the semantic interface: direct probing gives 75.9 versus 65.3 for generate+CLIP on 48/12. This is the most solid part of the paper.
Critical weaknesses
-
The headline gains depend on test-time access that most baselines do not have. Target calibration uses the whole unlabeled test set, while Flora, SkeletonContext and most methods in Table 2 are inductive. Without calibration the full model reaches 62.84 on NTU-60 48/12 (Appendix Table 7), below Flora (65.3) and SkeletonContext (64.4), on exactly the split where the paper claims its largest gain (+10.6).
-
The significance is narrow. The task is closed-set recognition on NTU and PKU-MMD with 5 to 24 unseen classes, and the core idea, using a frozen LLM's last-token hidden state as a class embedding, is already common practice for LLM sentence embeddings (e.g., PromptEOL), which is not cited. In the current LLM era, these gains say little beyond this specific benchmark setting.
Overall, I think the topic too narrow considering the current powerful MLLMs, including motion MLLMs, pose MLLMs, video MLLMs. This work is expected to be of very limited impact.
Questions for authors
-
Please report the full model without target calibration on all eight protocols, and separate inductive and transductive methods in Tables 2 and 3.
-
Under the same test-time access, how does MotionProbe compare with transductive methods? Skeleton-Cache is in Table 2, but PGFA is discussed and not compared.
-
Calibration is run on the same test set that is evaluated. What happens if calibration uses a disjoint unlabeled set?