- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper introduces UPCDD, a label-free dataset distillation for object-wise point clouds. First an encoder is trained via masked-reconstruction, to later on supply features for the adaptive clustering. The adaptive clustering is done via k-means and is used to partition the dataset into subsets, to provide similar partition to how labeled dataset can be split into object categories. The resulting partition indices and confidence weights replace the semantic labels in DD3D- and SADM-based distillation, so reusing these approaches becomes trivial. Feature alignment and dispersion regularization augment the matching objective used during the distillation process. The paper evaluates classification, part segmentation, and transfer across datasets and architectures.
Critical strengths
-
The problem setting is well motivated: producing reusable synthetic training data without requiring shape or point annotations is an extension of point-cloud distillation. The formulation makes the role of proxy supervision explicit and is instantiated with both gradient and distribution matching. Extending the construction to pseudo-parts is also relevant to the annotation-cost motivation.
-
There is evidence that the distilled sets carry does carry useful training information. Table 2 shows improvements over a frozen randomly initialized backbone. On ScanObjectNN at m=10, UPCDD-SADM reaches 42.99 percent versus 39.90 percent for Best PL-Core with the same reported K=5. The supervised experiments reported in table 4 also provide evidence that the proposed augmented objective can help existing distillation pipelines. Evaluation with fresh downstream networks, frozen linear probes, and label mappings fitted on the training split provides useful controls that strengthen these results.
Critical weaknesses
-
Incomplete reporting makes the compression and comparative results difficult to assess. Table 1 omits the selected K*, although the total distilled-set size is directly determined by it, preventing readers from determining the compression achieved by each configuration. Furthermore, Table 2 compares unequal total budgets, eg: on MVPNet100 at m=10, UPCDD-SADM uses 1,050 clouds versus 510 for the core-set. This does not establish an advantage at fixed storage. Network roles, dataset construction, and evaluation details also require piecing together the main text and appendix. No qualitative examples of the final synthetic clouds are provided, limiting inspection and intuition of their structure and diversity.
-
The practical motivation and contribution beyond existing pseudo-labeling approaches remain insufficiently established. The evaluated setting assumes already isolated, object-centric point clouds. This object-level scope should be clearer in the opening motivation. A relevant practical alternative is to obtain pseudo-labels from an external pretrained model and then apply an existing distillation method. A comparison at equal synthetic-data budgets, or an explanation of why such models are unsuitable for the intended setting could provide a stronger motivation. Moreover, replacing class labels with feature clusters for dataset distillation has precedent in 2D. Although the domain is different, the paper should identify which challenges specific to point clouds require new solutions and how its components address them. As presented, the methodological advance beyond adapting and combining existing ideas remains unclear.
Questions for authors
-
What K* was selected for each Table 1 configuration? would be great to know the total number of synthetic clouds and its ratio to the original training-set size.
-
Are there any representative examples from the final synthetic datasets, alongside real point clouds from the corresponding partitions, to illustrate the geometry and diversity retained through distillation?
-
How does UPCDD compare with using an external pretrained model to obtain pseudo-labels, followed by the existing distillation method? Are there any technical challenges specific to object-centric point clouds that required changes beyond the clustering-based strategy done in the 2D domain?
W3: Full-Data and self-supervised References
Please let us know if any concerns remain unaddressed. We are happy to discuss them.