- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper mainly investigates whether a large number of 2D images can be used to train a 3D texture generation model, so as to reduce reliance on expensive 3D training assets. It constructs training samples by cropping images and transforming them in 3D space. Then it trains a shared VAE encoder for 2D images and 3D textures, and finally trains a DiT to generate surface textures for 3D objects. The main contribution is a paradigm that uses 2D images as a substitute for 3D texture assets, enabling a unified representation between the two.
Critical strengths
- The research problem carries good practical value and the method shows promising potential. It can leverage abundant 2D images as an alternative to 3D texture libraries. 2. The method is concisely designed, and its data construction pipeline can yield rich geometric structures. 3. By unifying the representations of 2D reference images and 3D textures, it reduces the representation gap between separate encoders and facilitates the transfer of fine-grained details.
Critical weaknesses
- The model takes geometry and reference views as inputs. Good results may primarily stem from transferring existing details from the reference images onto the surface. The generation quality for non-visible regions is not reported. 2. The description of training for shared 2D–3D features is insufficiently clear. Although experimental results are presented, the training sources for each component (e.g., VAE and DiT) are not explicitly stated. The reasons behind the performance improvements remain unclear. 3. Evidence for generalization on real-world geometry is limited. The test set is inadequately described in terms of categories and geometric complexity. While manual rotation can simulate different viewpoints and occlusions, it cannot account for textures on naturally curved surfaces.
Questions for authors
- It is recommended to add evaluations on the texture generation quality for invisible regions, as well as the texture synthesis results on real curved surfaces. 2. The training setup for the shared feature module should be elaborated further. Ablation experiments are also needed to verify that the performance gain indeed comes from the shared-feature design.