- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates LiDAR SSL that does not rely on camera images, camera-LiDAR calibration, or cross-modal correspondences, learning semantic representations of LiDAR range-view images by DINOv3 feature distillation.
Critical strengths
This paper proposes a LiDAR self-supervised representation learning scheme that does not rely on camera data.
The method directly feeds LiDAR range-view images into a pretrained VFM and supervises the LiDAR encoder through feature distillation, requiring neither camera images nor camera-LiDAR calibration or cross-modal correspondences. This design reduces dependence on multimodal data acquisition conditions and has practical value in application scenarios lacking annotations or other sensor data.
Critical weaknesses
There is an inconsistency between the method design and the experimental results. The authors present VFM feature distillation and MAE reconstruction as core components of a joint framework, yet table 1 show that distillation alone already achieves the best results and that adding MAE brings about negative effects. Therefore, the paper has not sufficiently demonstrated the necessity of the joint framework or the independent value of MAE, and the overall narrative lacks consistency with the experimental findings.
Questions for authors
The evaluated datasets primarily feature structured spinning-LiDAR range views, where scan lines provide a relatively regular spatial organization. However, solid-state and semi-solid-state LiDARs can exhibit substantially different and potentially irregular sampling patterns, making their conversion into suitable range-view representations more challenging. It remains unclear whether the proposed image-based distillation framework can learn effective representations under such conditions, limiting the evidence for its applicability to diverse modern LiDAR sensors.
7 comments
Updated manuscript
Dear reviewer,
We have now updated the manuscript with the following key changes to address the raised weaknesses and questions. Line, table, figure, and section numbers refer to the new manuscript version.
| Weakness | Manuscript update |
|---|---|
| There is an inconsistency between the method design and the experimental results. The authors present VFM feature distillation and MAE reconstruction as core components of a joint framework, yet table 1 show that distillation alone already achieves the best results and that adding MAE brings about negative effects. Therefore, the paper has not sufficiently demonstrated the necessity of the joint framework or the independent value of MAE, and the overall narrative lacks consistency with the experimental findings. | We agree, and we have modified the narrative, where we no longer discuss "geometric" learning from MAE, and where our main experiments on Waymo data are now VFM distillation only (see Tables 1, 2, and 3). However, we have kept in Table 4 the experiment where it is shown that MAE does not improve VFM distillation only for Waymo, and in Table 5 we have added a row where it is shown that, for SemanticKITTI, adding MAE has actually made the result 2.1 mIoU points better than with VFM distillation only. As discussed in lines 476-480, we interpret that this may be a result of SemanticKITTI's less ordered and clean intensity images, which degrades the quality of VFM features that we distill from, and thus MAE can help in improving learning where the VFM input is poorer. |
| Question | Manuscript update |
|---|---|
| The evaluated datasets primarily feature structured spinning-LiDAR range views, where scan lines provide a relatively regular spatial organization. However, solid-state and semi-solid-state LiDARs can exhibit substantially different and potentially irregular sampling patterns, making their conversion into suitable range-view representations more challenging. It remains unclear whether the proposed image-based distillation framework can learn effective representations under such conditions, limiting the evidence for its applicability to diverse modern LiDAR sensors. | It is a good point that we had not considered before. While the LiDAR in SemanticKITTI is spinning, the actual data is provided as 3D coordinates after ego motion compensation, which as discussed extensively in prior range-view art, and as can be seen in our Figure 3, produces a distorted image when projecting it to the range-view. So, to some extent, in our work the effect that is referred to has already been present. Still, it is possible that solid-state LiDARs, which may scan the environment in an even less structured manner than what one gets from SemanticKITTI, do not see as much benefit from our method. We have added lines 522-525 in the conclusion to acknowledge this potential limitation. |
We would like to thank you again for your feedback that has helped to improve the paper, and remain open to further feedback and suggestions.
Thank you for the clarifications.
I still suggest that the authors reconsider and restructure the narrative of the paper. If MAE is intended as a baseline for comparison, it should not appear in the "Framework Overview" or "Method" sections. Conversely, if MAE is presented as one of the contributions of this work, the current results fail to demonstrate its effectiveness.
Therefore, I regret that I cannot increase the score.
Dear reviewer, Thank you for your feedback. Although we thought that the MAE results would be valuable knowledge to publish; as the first work, to the best of our knowledge, that attempted MAE on LiDAR images; the authors agree with your reported critical weakness about MAE, which in fact has also been pointed out by the other reviewers. Therefore, instead of making MAE a central part of our contribution, in the next paper revision we will treat the MAE branch as an add-on, but deactivate it in the main experiments, which will become more focused mostly on stand-alone VFM distillation instead. We still find value in publishing the MAE and VFM+MAE scores, although as a side-experiment instead of centrally. While the spinning-LiDAR data in the Waymo and Ouster datasets are natively structured as images, data in SemanticKITTI are not, which already produces significant performance degradation when using our LiDAR image-based method. This is discussed in Section 4.1, in the paragraph where Table 5 is referenced. We agree with the reviewer that, for modern solid-state LiDARs, which typically sample the environment in rather irregular patterns, converting data to the range-view is expected to result in a substantially worse image structure, which is expected to degrade performance of our method significantly compared to the performance that one could expect for Waymo and Ouster datasets. We will add this clarification in the next revision of the paper.