- Rating
- 4
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This article proposes LoReTTA, a training-free test-time adaptation method for 3D point cloud vision-language models. The authors observed that even when point clouds are subjected to different types of corruptions, the target test set still retains a certain low-rank structure, and the raw feature relations, low-rank relations, and semantic prediction relations can provide complementary information. Based on this, LoReTTA constructs a multi-relational view, models target sample dependencies through self-representation, and uses relation-mode low-rank consensus recovery to fuse different relations. Finally, prediction refinement is performed through a sparse consensus graph. The authors conducted experiments on ModelNet-C, ShapeNet-C, ScanObjectNN-C, and multiple open 3D benchmarks, and validated the effectiveness and robustness of the method on multiple 3D vision-language backbones.
Critical strengths
- Proposed a new perspective of using target set relational structure for test-time adaptation. Unlike traditional TTA methods that rely on a single feature or prediction information, LoReTTA simultaneously utilizes three types of relations: raw, low-rank, and semantic, and fuses them through low-rank consistency constraints, making the method design somewhat reasonable.
- The method does not require updating the backbone and has good practical application potential. The adaptation method that avoids parameter updates has practical significance for large-scale pre-trained 3D vision-language models. The experiment also covers multiple backbones and various corruption settings, and the verification is relatively sufficient.
Critical weaknesses
- The experiment mainly focuses on artificially constructed corruption benchmarks, with insufficient validation of real domain shifts. The ModelNet-C, ShapeNet-C and other datasets mainly construct test distribution changes by artificially adding noise, dropout, rotation and other methods, which still differ from sensor shift and cross-dataset changes in real scenarios. Therefore, current experiments have provided more evidence of corruption robustness, while the generalization ability of actual test-time distribution shifts still lacks sufficient validation.
- The method relies on modeling the relationship of the entire target set, and its applicability in online scenarios is not yet clear. LoReTTA needs to construct a relation matrix within the target set, so it is assumed that a batch of test samples can be accessed. For streaming or small batch testing scenarios, further clarification is needed to determine whether the method is still effective.
Questions for authors
- LoReTTA relies on target set-level relationship modeling. How will the performance of the method change if only a single test sample or a small batch can be obtained and the complete target distribution cannot be accessed?
- The current experiment is mainly based on synthetic corruption benchmarks. Has the author tested domain shifts across datasets or closer to real-world scenarios to validate the effectiveness of the method for actual distribution changes?
- Does the advantage of LoReTTA over existing training-free adaptation methods (such as cache-based or prompt-based VLM adaptation) mainly come from multi-relational modeling or from using larger-scale target set information? Can further fairness analysis be conducted?
Regarding the second question, it is not unique to you. It can be said that this is a problem that newcomers will encounter when using benchmarks from previous work. However, it is still hoped that the model can be evaluated or validated on real datasets, which is crucial for its practicality. Of course, as far as the current submitted work is concerned, it is already considered solid.