- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes MPD-3D, which is a self-supervised dataset distillation method for 3D point clouds. The method uses a masked autoencoder for 3D point clouds to train a teacher network (e.g., PointNet) and extracts target features. The initial synthetic point clouds are sampled from the original point clouds and the points of synthetic ones are optimized so that a student network trained on them can predict the target feature. Experimental results on MN40, MVP100FULL, and SONN show promising gain over previous coreset selection methods.
Critical strengths
- The paper first formulates the problem of self-supervised dataset distillation for 3D point clouds.
- The paper reports extensive experimental results such as cross-architecture generalization results and the effect of coordinate optimization.
Critical weaknesses
- Unfair comparison. In table1, previous subset selection methods (Random, Herding, and K-center) are trained by supervised learning, while MPD-3D is trained by self-supervised learning. It is hard to say that the performance gains over previous subset selection methods are from the proposed method.
Q1. Please report the comparison with Random, Herding, and K-Center which is trained by self-supervised learning (masked prediction with the teacher targets).
- Unclear effectiveness of dataset distillation. In Table 18, the effectiveness of coordinate refinement is unclear. It implies that the performance gains in Table 1 come from the existing masked predictive learning, not from the dataset distillation itself.
Q2. Please justify the benefit of the coordinate refinement itself.
Q3. In the distillation, the student network is trained for only 3 iterations, while the consumer network is trained for far more iterations. Please show the learning curve during training.
Questions for authors
See the Q1-Q3 in Critial Weaknesses.