- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
I used AI to assist with searching the relevant literature in order to assess whether the related-work comparisons were sufficiently comprehensive and whether the reported results indeed achieved state-of-the-art performance on the public benchmarks. However, all assessments and opinions expressed in the review, as well as the review itself, were written independently by me.
Critical strengths
-
The object-token-based, object-centric representation learning presented in this paper leads to substantial performance improvements in 3D understanding. By separating the object proposals from the representation supplied to the language model, the proposed formulation enables these two factors to be studied independently. Its effectiveness is further demonstrated across multiple downstream tasks.
-
The paper is well written, clear, and easy to follow.
-
The ablation studies are well designed. In particular, the object-token construction function is evaluated through comprehensive ablations.
Critical weaknesses
The core formulation consists of three components: the object proposals , the 3D representation encoder , and the object-token construction function . However, both the object proposal generators and the 3D representation encoders are adopted from existing open-source works, while is investigated using several relatively standard aggregation mechanisms. Consequently, the algorithmic novelty of the paper is limited, and the work does not introduce a novel theory or learning principle for representation learning.
Questions for authors
All five evaluation benchmarks are based on ScanNet. Therefore, the experiments demonstrate generalization across tasks, but not across data distributions. The paper also states that region descriptions of ScanNet instances are used during the object-token alignment stage. Could the observed performance gains be partly attributable to using alignment data drawn from the same underlying dataset or distribution as the evaluation benchmarks?