- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a fully parameter-free dynamic point cloud classification method: it uses linear optimal transport (LOT) to eliminate the permutation ambiguity of points, employs cumulative distribution transform (CDT) to encode temporal trajectories, and then performs classification using nearest subspaces. Experimental results also demonstrate the effectiveness of the proposed method.
Critical strengths
- The problem setting targeted by the paper is of considerable value, and it is the first work of its kind. It enables fast dynamic point cloud recognition without gradients or GPUs, which is an important requirement for rehabilitation monitoring and edge-device recognition, and it also offers stronger interpretability.
2.The combination of methods in the paper is relatively novel and is supported by sufficient theoretical analysis, which provides a solid foundation for the interpretability of the method.
Critical weaknesses
1.The paper claims the advantages of its method for dynamic point cloud processing, but in fact its experimental datasets are all joint-related. Although the conclusion states in future work that dense point clouds or LiDAR sequences will be processed later, the difference between the two lies not only in data distribution but also in the number of points. I am concerned that dense point clouds may cause the computational complexity of the method to far exceed that of existing learnable neural networks, causing the advantages of the paper's method to be lost.
- There are some problems with the experimental setup, which reduce its credibility: (a) The FLOPs reported in the appendix indicate that for the other methods the computational cost is measured over multiple forward passes during training, whereas the proposed method reports only a single forward pass. This unfair comparison can only demonstrate the advantage of requiring no training, while the computational cost at inference time remains unknown. (b) The other methods should all have been retrained on the joint data, and Table 10 in the appendix shows a case where PointNet4D achieves lower performance with 90% of the training data than with 10% of the training data, which raises concerns about whether the training of these baselines is reasonable or sufficient. (c) The experiments are not sufficiently comprehensive; for example, ablation studies on techniques such as LOT, CDT, and joint shuffling are missing.
Questions for authors
- The techniques proposed in the paper are claimed to be for dynamic point clouds, but I am concerned that for dense point clouds or LiDAR sequences, in addition to the difference in data distribution, the difference in the number of points may cause the complexity of the proposed method to increase substantially, so that its computational cost may become worse than that of learnable neural models. Therefore, has the author considered changing the task target, or further demonstrating the generality of the method?
2.The methods compared in the experiments should all need to be retrained on the dataset. Could the corresponding training settings be provided? This is because some strange results currently appear in the paper (the discrepancy between the two performances of PointNet4D in Table 10 of the appendix), which may raise concerns about whether the compared methods were trained sufficiently or reasonably.
3.Why not consider reporting the GFLOPs of a single forward pass at inference time for each method? This would be fairer.
4.The current experiments are not yet complete, especially the ablation studies on the various techniques in the model, including LOT, CDT, etc.
3 comments
Could we analyze the comparison of computational costs between other methods and your method when the number of point clouds increases? Based on my previous experience, when the number of point clouds increases significantly, the growth rate of computational costs for the parameter-free method is higher than that of other trainable methods.
We sincerely thank the reviewer for taking the time to raise this thoughtful and constructive comment. We appreciate the opportunity to address this point and further clarify our work.
To address the reviewer’s concern regarding the computational cost associated with an increased number of points in the data, we conducted an additional experiment on the dense PCVD (Point Cloud Video for Dynamic Human Interaction) dataset [1]. For a head to head comparison, we use 10% of the training data for both the deep learning-based trainable models and our proposed method. Our method outperforms the deep learning-based baselines in terms of both computational efficiency and predictive performance.
These results demonstrate that increasing the number of point-cloud samples does not adversely affect the computational efficiency or predictive performance of our method.
| Model | Accuracy (%) | Precision (%) | Recall (%) | F1 Score (%) | FLOPs (Single Forward Pass) | Latency (ms) |
|---|---|---|---|---|---|---|
| P4Transformer | 55.38 | 59.05 | 55.38 | 53.27 | 74.59 MFLOPs | 12.5190 |
| PointLSTM | 37.31 | 38.75 | 37.31 | 35.14 | 1.39 GFLOPs | 49.1811 |
| PSTNet | 21.15 | 26.60 | 21.15 | 18.14 | 2.44 GFLOPs | 155.6451 |
| SequentialPointNet | 18.46 | 20.23 | 18.46 | 17.86 | 818.82 MFLOPs | 13.4058 |
| Proposed_KIMORE | 56.15 | 64.41 | 56.15 | 55.23 | 3.32 MFLOPs | 0.5000 |
However, we would like to reiterate that the primary scope of this work is skeleton-based and sparse point-cloud-sequence human motion classification, as consistently stated in the Introduction (lines 38–42, 44, 52), Literature Review (line 84), Method (lines 121, 169), and Dataset Details (line 303). We also explicitly note in the Future Work section that dense point cloud analysis lies beyond the scope of the present study and is left for future investigation.
For this reason, the above experiment is provided solely to address the reviewer’s concern. We do not intend to include results on dense dynamic point clouds in the final version of the paper.
Instead, we will carefully refine the wording throughout the manuscript (particularly the title and abstract) to more precisely align our scopes & contributions with prior works [2, 3, 4, 5] that similarly focus on sparse point-cloud-sequence-based human motion classification.
References
[1] Li, Jie, et al. "Pcvd: A dataset of point cloud video for dynamic human interaction." Proceedings of the 16th ACM Multimedia Systems Conference. 2025.
[2] Fan, Hehe and Yu, Xin and Ding, Yuhang and Yang, Yi and Kankanhalli, Mohan. "Pstnet: Point spatio-temporal convolution on point cloud sequences." The International Conference on Learning Representations (ICLR). 2021.
[3] Fan, Hehe and Yang, Yi and Kankanhalli, Mohan. "Point 4d transformer networks for spatio-temporal modeling in point cloud videos." Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR). 2021.
[4] Li, Xing and Huang, Qian and Wang, Zhijian and Yang, Tianjin and Hou, Zhenjie and Miao, Zhuang. "Real-time 3-d human action recognition based on hyperpoint sequence." IEEE Transactions on Industrial Informatics. 2022.
[5] Min, Yuecong and Zhang, Yanxiao and Chai, Xiujuan and Chen, Xilin. "An efficient pointlstm for point clouds based gesture recognition." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2020.
We are grateful for the reviewer’s helpful suggestions, which have improved the clarity of our paper.
(W1 & Question 1)
We use “dynamic point clouds” as a general descriptor to characterize the spatiotemporal structure of these datasets, where 3D joint coordinates (X,Y,Z) evolve over time (t), providing the basis for developing our method.
However, our research scope is exclusively focused on skeleton-based data, as clarified in the Introduction (lines 38–42, 44, 52) and Literature Review (line 84). The Method section explicitly states, “In geometric settings such as skeleton-based human pose representations...” (line 121) and further explains the alignment of skeleton data with Brenier’s theorem (line 169). Additionally, the Dataset Details section explicitly identifies our scope as a “skeleton-based dynamic motion classification benchmark dataset” (line 303).
Clarifying and Narrowing the Described Scope of the Target Task in the revised Manuscript
Nevertheless, we agree with the reviewer’s concern and, to better communicate the scope of this research, will narrow down and revise the paper’s title and relevant descriptions, where necessary, to more accurately represent the target task as skeleton-based sparse dynamic point-cloud classification rather than dense dynamic point-cloud classification.
(W2) (a & Question 3)
We report total training FLOPs for all baselines including our proposed method, not for a single forward pass. Deep models need many epochs of forward and backward passes to reach good accuracy, while ours is a non-iterative, closed-form fit: one single pass over the training data (alignment and CDT) plus an SVD. A single forward pass over an untrained neural network gives chance-level accuracy, whereas one pass of our method already yields its final, mature performance. Therefore, a single-pass comparison would not reflect the cost of reaching comparable accuracy, so total training FLOPs is the fair basis. We will state this explicitly in the revised manuscript.
(b & Question 2)
We re-verified the end-to-end training pipeline and confirmed that retraining the baseline methods reproduces the reported results.
We attribute the near-chance performance of PointRNN and PointNet4D on UI-PRMD, which remains largely unchanged as training data increases from 10% to 90%, to potential limitations of these architectures in capturing the dataset's discriminative motion patterns. This limitation appears model-specific, as other models perform well on the same dataset. In contrast, both PointRNN and PointNet4D perform competitively on KIMORE, NTU, and MSR, with performance improving as training data increases from 10% to 90%.
We also warmly welcome the reviewer to consult the provided complete codebase for independent verification and reproducibility of our results.
(C & Question 4)
We report component-wise ablation results for our proposed method across five random seeds, presenting mean ± standard deviation for robust evaluation.
Componentwise Ablation Study (reporting accuracy)
Additionally, we have added benchmark comparisons with non-parametric static point-cloud classification models, whose poor performance on dynamic data highlights their limitations in capturing underlying spatiotemporal patterns. Please see our responses to Reviewer BFkX (W2 & Question 2) for details.