- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The authors propose the method called GAMFusion and demonstrate its effectiveness on 3 3D segmentation datasets. The main architecture is a 2-branch fusion structure with 2D and 3D branch. The idea is to maintain the geometric consistency of the 2D and 3D branch. This work aims to address a problem that may occur after lifting 2D features to 3D. If Euclidean distance is used for neighborhood construction, features from different surfaces may easily be mixed together. It may make it difficult to maintain geometric consistency. So, the method has four stages: the explicit 2D stage, the pre-voxelization stage, which is similar to geometry-guided bilateral filtering, the post-voxelization stage, which uses an improved distance metric, and the decoder which follows a standard transformer design. However, the modules proposed by the authors are all combinations of existing techniques. From the perspective of network learning, this work's novelty is limited. The narrative of the paper is not very good, the experiments are simple and insufficient. This may not be enough to meet the accept standard of ICLR. I suggest that the authors improve the writing and make the experiment more complete. In particular, the problems identified in the motivation section currently lack supporting experimental data. After these improvements, I suggest submitting the manuscript to other top conference or journal in the computer vision field.
Critical strengths
- The authors explain the problem clearly, making it easier for readers to understand the problems with current methods based on Euclidean neighborhoods. However, supporting experimental data are lacking (see the Weaknesses 2 below).
- The figures are well drawn and clear. Readers can understand the method clearly just by looking at the figures.
- The method section is written clearly. So it should be relatively easy to reproduce the method.
Critical weaknesses
- I think the main problem is that the contribution of the proposed method is insufficient. In my view, the most valuable part is the use of normal-aware k-NN. The other parts are all relatively common. This small innovation may not be enough for ICLR. Of course, I think a small innovation can be acceptable. However, the insights provided by normal-aware k-NN for the field of 2D-3D modality fusion and related fields may not be sufficient.
- I have some suggestions about the narrative of the paper. Although the method section is written clearly and makes it easier for readers to reproduce the method, the main thread of the paper may have been weakened. As shown in Section 1 (Introduction), the authors organize the paper around an overall framework. This is acceptable, but it does not highlight the problem with Euclidean k-NN retrieval. This is the part that this type of work should discuss in detail, as in Figure 2. Figure 2 is quite well drawn, but the related discussion is too limited. It also lacks supporting experimental data. More visualizations would be better. I suggest that the authors add more relevant content.
- The experimental section also has problems. First, too few architectures are compared. The current baselines are relatively classic, and some recent works are missing, including some well-known architectures such as PTv3. Judging from the experimental section, the paper does not look very professional. Discussing only inference cost without discussing model size may not be enough. The authors mention "boundary-sensitive" in the conclusion, but the related experiments are missing. The current evaluation metrics do not seem to reflect boundary sensitivity.
- I also have some suggestions about the structure and formatting of the paper. Section 2 Related Work is currently too long. This may make it difficult for the authors to clearly explain the problems with existing methods. Tables 2 to 4 contain very little data but take up a lot of space. This may also leave the authors with insufficient space to explain the motivation. In addition, for a comparison table like Table 1, it would be better to include the publication year of each method.
- From Table 1, the improvement on Tail is quite large. The authors could further analyze the reasons for this in the future.
Questions for authors
The motivation and method of this paper are simple, so I can understand this work. I do not have any questions for the authors. For suggestions on improving the paper, I suggest referring to the Weaknesses part.