- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
LoCoFormer proposes Bilateral Context Attention, a dual-branch geometric/semantic attention with bilateral fusion, plus architecture modernization for point cloud classification and segmentation tasks. Experiments cover ModelNet40, S3DIS, ScanNet-v2, and ScanNet200. Overall, despite competitive indoor results, the work is weakened by the absence of outdoor road scene validation with occlusion and varying point densities.
Critical strengths
- The paper tackles limited local geometric context modeling in point cloud Transformers.
- BCA combines coordinate and feature branches via learnable geometric encodings and bilateral fusion for attention.
- Ablations show benefits from BCA interactions, PSS, sparse embedding, and partition pooling on indoor benchmarks.
Critical weaknesses
- Missing outdoor road scene validation. All classification and segmentation experiments are indoor (S3DIS, ScanNet v2/200). No SemanticKITTI, nuScenes, WHU-MLS, Waymo, or other outdoor road scene tests, so generalization to sparse, large-scale, occlusion-heavy road scenes is unproven.
- BCA is an incremental dual-branch attention design; PSS follows PTv3/OctFormer-style serialization, sparse-convolution embedding is standard, and partition-based pooling follows PTv2. The contribution over PTv3/LitePT is partially modular assembly.
- BCA is not fully evaluated in the segmentation setting. Appendix A.2 states that for semantic segmentation, BCA is used only in the first two stages, while the remaining stages use conventional Softmax attention. The paper does not ablate full-stage BCA versus this partial deployment, nor does it justify why BCA is omitted from later stages. This weakens the claim that BCA is the main source of segmentation gains and makes it difficult to separate its contribution from the architecture modernization and PTv3-style components.
- Gains over PTv3 are small (0.7% ScanNet v2, 1.1% S3DIS), with no outdoor baselines, few cross-dataset transfers, few robustness tests under density/occlusion changes, and no statistical variability.
Questions for authors
- Can LoCoFormer be evaluated on SemanticKITTI, nuScenes, or Waymo under the same protocol to verify generalization to sparse, large-scale outdoor road scenes?
- What is the parameter-matched gain of BCA alone versus PTv3-style attention, and why is BCA used only in the first two segmentation stages?
- How do PSS, sparse-convolution embedding, and partition pooling differ materially from prior work, and how does the S×3S geometric encoding scale with patch size?
4 comments
Response to Reviewer YHRw
Thank you for your comment. We have provided additional ablation studies that independently modify the attention mechanism. Please refer to Table G in the Appendix for details.
To reduce memory overhead and mitigate overfitting, we employ BCA only in the first two stages, as explained in the Appendix (Section A.2).
The ablation results in Table G of the Appendix clearly demonstrate the performance gains brought by both BCA and Architecture Modernization, further substantiating the contributions of our work.
Response to Reviewer YHRw
Thank you for your comment. The proposed Architecture Modernization is inspired by previous works, but has been tailored at a fine-grained level to work synergistically with our proposed BCA. Importantly, we would like to emphasize that the motivation behind Architecture Modernization is not to pursue methodological novelty within individual components, but rather to systematically analyze and explore architectural designs of point cloud Transformers beyond the attention mechanism. To the best of our knowledge, our work is the first to pursue this objective.
The two-stage design and bilateral fusion mechanism of BCA are specifically tailored for 3D point clouds, making BCA both novel and effective. Unlike images, which consist of regularly arranged pixels, point clouds are inherently sparse, irregular, and unordered. These differences make our BCA fundamentally different from existing methods in the 2D image domain. Furthermore, the geometric context branch of BCA independently processes point coordinates, providing spatial distribution and geometric structure information. This design also distinguishes our BCA from existing methods in the 3D vision domain.
The shape of can be aligned with the query, key, and value of the semantic context after being mapped through the transformation layers, as explained in Eq. (7). The patch size is only related to the receptive field of the network and does not affect the geometric encoding of each individual point.
Thanks to the authors for their improvement. I will keep my score unchanged.
Response to Reviewer YHRw
Response to Question 1, Weakness 1, and Weakness 4: Thank you for your comment. We have supplemented experiments on outdoor datasets. Please refer to Table F in the Appendix for details.
We hope you can appreciate that achieving performance improvements of 1.1 and 0.7 on the challenging S3DIS and ScanNet v2 benchmarks, respectively, represents a remarkable gain. For reference, we encourage you to consult previous top conference works [1-10] that report ablation studies on these benchmarks.
[1] Wan, Jiaxu, et al. "SP 2 T: Sparse Proxy Attention for Dual-stream Point Transformer." 2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025.
[2] Zeng, Ziyin, et al. "DeepLA-Net: Very deep local aggregation networks for point cloud analysis." 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2025.
[3] Wu, Xiaoyang, et al. "Point transformer v3: Simpler, faster, stronger." 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024.
[4] Thomas, Hugues, et al. "Kpconvx: Modernizing kernel point convolution with kernel attention." 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024.
[5] Deng, Hao, et al. "Linnet: Linear network for efficient point cloud representation learning." Advances in neural information processing systems 37 (2024): 43189-43209.
[6] Duan, Lunhao, et al. "Condaformer: Disassembled transformer with local structure enhancement for 3d point cloud understanding." Advances in Neural Information Processing Systems 36 (2023): 23886-23901.
[7] Qian, Guocheng, et al. "Pointnext: Revisiting pointnet++ with improved training and scaling strategies." Advances in neural information processing systems 35 (2022): 23192-23204.
[8] Lai, Xin, et al. "Stratified transformer for 3d point cloud segmentation." 2022 IEEE/CVF conference on computer vision and pattern recognition (CVPR). IEEE, 2022.
[9] Wu, Xiaoyang, et al. "Point transformer v2: Grouped vector attention and partition-based pooling." Advances in neural information processing systems 35 (2022): 33330-33342.
[10] Qian, Guocheng, et al. "Assanet: An anisotropic separable set abstraction for efficient point cloud representation learning." Advances in Neural Information Processing Systems 34 (2021): 28119-28130.