- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper identifies two key limitations in existing 3D point cloud self-supervised learning methods: (1) the lack of explicit modeling of geometric dependencies between masked patches, and (2) the tendency of masked point modeling objectives to focus primarily on local geometric reconstruction while insufficiently capturing object-level semantic consistency.
Critical strengths
- The paper presents a clear and intuitive problem. It separates the limitations of masked point modeling into structural dependency modeling and global semantic consistency, and designs LAA and GSD to address the two aspects respectively.
- The proposed framework is simple and minimally intrusive to existing masked point modeling architectures. Both LAA and GSD are introduced as auxiliary pre-training objectives without substantially changing the backbone, and the additional modules are discarded during downstream fine-tuning.
Critical weaknesses
-
The motivation behind LAA is not fully convincing. LAA treats the -th and -th masked tokens as structurally related simply because they are consecutive in a predefined ordering. However, consecutive tokens are not necessarily geometric neighbors. For example, under FPS ordering, two consecutively sampled patches may lie on distant parts of an object rather than on the same local surface, so predicting the previous token does not necessarily correspond to modeling a meaningful geometric transition. Moreover, since the decoder uses bidirectional self-attention, the predictor may already access information from the target token, introducing potential information leakage into the autoregressive prediction.
-
The ablation on LAA is not fully controlled. In Table 5, the Point-MAE baseline and the LAA variant appear to use different augmentation settings. Since the proposed model uses rotation augmentation while the original Point-MAE does not, it is unclear how much of the reported improvement can actually be attributed to LAA.
-
The comparison with prior work is outdated. Most of the baselines are from 2022–2023, while recent methods from 2024–2026 are largely missing. This makes the claimed state-of-the-art performance difficult to assess.
Questions for authors
- Could the authors clarify why consecutive masked tokens under the chosen ordering should correspond to meaningful geometric neighbors? It would also be helpful to compare alternative orderings and explain how information leakage is avoided under bidirectional self-attention.
- Did the LAA variant in Table 5 use rotation augmentation? If so, please provide a Point-MAE baseline trained with the same augmentation rather than directly using the originally reported result.
- Could the authors include comparisons with more recent methods from 2024–2026 in the experimental section?
My current rating places the score between 1 and 2 (closer to 1). If the authors can clarify the data augmentation and include comparisons with more recent literature, I would consider raising the score to 2 or 3.