- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents ShapeDINO, a family of large-scale self-supervised encoders for object-centric 3D shapes. The method uses a PointNet-style tokenizer with FPS/KNN grouping followed by a standard Vision Transformer with 3D RoPE, and adopts a DINO-style teacher–student framework that combines global DINO supervision with patch-level iBOT learning to capture both object-level semantics and dense local structure. To scale training efficiently, the authors introduce a 3D multi-crop strategy that reuses a shared spatial grouping across crops, and construct a curated 1.5M-object pretraining corpus from Objaverse-XL through geometric filtering, deduplication, and feature-space rebalancing. The model family ranges from 6.9M to 1.14B parameters, with smaller variants distilled from the Giant model. Experiments show strong frozen-feature performance on classification and part-segmentation benchmarks, as well as transfer gains in 3D generation, promptable segmentation, and point-cloud completion. Overall, the paper argues that a carefully engineered DINO-style self-supervised recipe can be scaled effectively to produce strong and reusable object-level 3D representations
Critical strengths
-
Strong engineering execution and comprehensive empirical validation. ShapeDINO presents a complete large-scale 3D self-supervised pretraining pipeline, including efficient point-cloud multi-crop construction, data filtering/deduplication/rebalancing, model scaling up to 1B parameters, and distillation into smaller variants. The evaluation is also broad: beyond frozen kNN/linear probing on classification and part segmentation, the learned representations are transferred to 3D generation, promptable segmentation, and point-cloud completion. This breadth makes the empirical contribution substantial even though the individual methodological components are largely based on prior work.
-
The learned representations are strong at both global and dense local levels. ShapeDINO achieves competitive frozen-feature performance on both object classification and part segmentation, with particularly strong dense-feature results under simple point-wise linear probing. The downstream experiments further show that the pretrained features are not only benchmark-specific but can improve different 3D tasks, including Point-SAM segmentation and point-cloud completion. This provides convincing evidence that the representation itself is reusable and practically useful.
Critical weaknesses
-
Limited methodological novelty and insufficient comparison with closely related prior work.
Most of ShapeDINO’s core ingredients have clear precedents, including the point tokenizer + ViT architecture, DINO/iBOT/KoLeo objectives, EMA teacher–student training, 3D RoPE, knowledge distillation, and feature-space-based data rebalancing. Closely related works such as PointCAM, AsymDSD already explore DINO-style/self-distillation-based representation learning for object-centric point clouds, including multi-crop training and large-scale pretraining. The current paper therefore appears primarily to scale and integrate an established recipe not introduce a fundamentally new representation-learning principle. A direct comparison with these closely related methods is important for establishing the paper’s novelty. -
The central scaling claim is confounded by distillation and data curation.
The model-scaling results do not provide a clean from-scratch scaling curve: the Giant model is pretrained from scratch, whereas the smaller variants are largely distilled from the Giant teacher. Since the paper itself shows that distillation provides non-negligible gains, improvements across model sizes cannot be attributed solely to parameter scaling. Similarly, the data ablation suggests that curation/rebalancing may be at least as important as raw scale: on ScanObjectNN, balanced 100K already outperforms raw 1.5M, while increasing balanced data from 100K to 1.5M provides only a modest gain (table 3). Consequently, the experiments more clearly establish the effectiveness of the overall training recipe than model/data scaling itself. -
The data contribution is primarily curation of an existing dataset not a new dataset contribution.
Questions for authors
-
Could the authors clarify the methodological distinction between ShapeDINO and closely related prior work such as PointCAM (Self-supervised Adversarial Masking for 3D Point Cloud Representation Learning) and AsymDSD (Asymmetric Dual Self-Distillation for 3D Self-Supervised Representation Learning), and ideally provide a direct comparison under a matched evaluation protocol? From my current understanding, the main differences of ShapeDINO appear to be a more DINOv2-like recipe, larger-scale training, and several engineering improvements. A clearer comparison would help establish what is genuinely new beyond scaling and integration.
-
Could the authors provide a cleaner from-scratch scaling study that disentangles model size from distillation, and data scale from curation? The current model-scaling curve mixes scratch-trained Giant with smaller models distilled from the Giant teacher, while the data ablation suggests that balancing/curation contributes substantially relative to raw data scale. Since “scaling” is central to the paper’s framing, a matched from-scratch comparison across several model sizes, or a more explicit decomposition of these effects, would substantially strengthen the main claim.
Even though I challenge the paper’s framing somewhat reframing of established ideas and the scaling claims overstated, I still consider the engineering effort, empirical coverage, and resulting representations strong, and I hope authors can address my concerns during rebuttal.