- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Patch-Aware Rotary Encoding (PaRE) for masked point cloud representation learning. The main idea is simple: a point cloud token summarizes a local patch, but standard rotary positional encoding only depends on the patch anchor and does not directly reflect the geometry within that patch. PaRE therefore adds the anchor-to-centroid offset as a residual to the rotary phase, allowing attention to capture both the relative positions of patch anchors and differences in local patch geometry. The design is lightweight, with only a small number of additional learnable parameters. Experiments on several classification and segmentation benchmarks show consistent gains over the anchor-only baseline and competitive results compared with recent methods.
Critical strengths
- The motivation is clear and well grounded. The paper identifies an intuitive mismatch between patch-level token representations and anchor-only positional encoding, and the proposed patch-aware formulation directly addresses this limitation.
- The solution is simple, technically clean, and effective. PaRE augments the standard anchor-based rotary phase with a residual derived from the anchor-to-centroid offset, allowing pairwise attention to capture both anchor displacement and differences in local patch geometry. This introduces only a very small number of additional parameters, while consistently improving over the anchor-only baseline and achieving competitive results across multiple downstream tasks.
Critical weaknesses
The role of the masked latent prediction framework is not well motivated. It is neither a novel component nor a design that directly follows from the motivation of patch-aware rotary encoding. Similar latent prediction objectives have already been widely explored, and it remains unclear why this particular framework is needed for PaRE or what additional contribution it brings to the proposed method.
Questions for authors
Could the authors clarify whether the masked latent prediction framework is a necessary component of PaRE? If not, please provide results using a standard masked point modeling setup, such as Point-MAE-style coordinate reconstruction, to enable a fairer comparison with Point-MAE.
2 comments
Thank you for the clarification and the additional experiments. The results on Point-MAE and Point-M2AE help clarify the role of RaPE and its applicability to other pre-training frameworks. I appreciate the authors’ response and will maintain my original score.
Could the authors clarify whether the masked latent prediction framework is a necessary component of PaRE? ...
We thank the reviewer for this comment. The masked latent prediction framework is not a necessary component of RaPE; rather, we adopt it as an effective pre-training framework that provides supervision for representation learning. RaPE operates on positional encoding within attention, serving a different function, and we do not claim the framework itself as a novel contribution. Similar approaches have been explored: point2vec[1] predicts teacher latent features of masked patches to learn semantic point cloud representations using global context, while Point-JEPA[2] predicts latent representations of masked regions to learn structural dependencies between regions. Both demonstrate the effectiveness of masked latent prediction for point cloud representation learning and downstream transfer.
To further validate RaPE, we integrate it into other frameworks, including Point-MAE and Point-M2AE, while fully retaining their original reconstruction objectives. Tab.1 and Tab.2 show that RaPE’s centroid-offset encoding substantially improves both frameworks under these established reconstruction objectives.
Table 1
Table 2
[1] point2vec Self-Supervised Representation Learning on Point Clouds. GCPR 2023.
[2] Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloud. WACV 2025.