- Rating
- 1(−1)
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes polarization-guided single-view 3D generation, which uses the angle of linear polarization (AoLP) as a complementary surface-orientation cue to an RGB image. A surface encoder fuses frozen DINOv3 RGB features with a trainable AoLP U-Net branch under normal supervision. The resulting surface tokens condition a pretrained Step1X-3D generator, which is adapted via LoRA with a latent consistency loss and a multi-view rendered-normal loss. The authors also build OBJMV3D, a synthetic dataset of 60K Objaverse assets with rendered RGB, AoLP, normals, and text, and evaluate on 100 held-out synthetic objects.
Critical strengths
None
Critical weaknesses
- Limited technical insight. Feeding AoLP into the network as an additional input alongside RGB and other conditions is a common and fairly straightforward practice in the community. The paper does not analyze how AoLP orientation evidence leads to better 3D results. For example, it never examines how the AoLP branch resolves the pi-ambiguity and the diffuse–specular ambiguity it describes in Sec. 3.2, or which regions benefit from it. The authors themselves acknowledge (Appendix A) that there is no comparison against normals predicted from RGB by an external estimator. It is therefore unclear whether the gain comes from polarization specifically or simply from normal conditioning.
- The value of the OBJMV3D contribution is limited and hard to assess. OBJMV3D is built directly from existing Objaverse assets, and its curation and cleaning are described only briefly and qualitatively (Sec. 4). The paper does not describe how materials were assigned for polarimetric rendering, which directly determines whether the synthetic AoLP is physically meaningful. It does not report the distribution of reflective or weakly textured objects, even though these are the cases the paper targets. With the current information, the quality of the dataset cannot be judged, which limits this contribution.
- The experiments do not demonstrate superiority over modern foundation models. The method is only demonstrated on toy examples with simple structures, such as the skull, cube, penguin, and bottle in Fig. 5, all of which are synthetic renderings. Quantitatively, the model is worse than its own backbone Step1X-3D in Chamfer Distance (0.0089 vs. 0.0064, Table 1). Its advantage is reported only in CLIP-SIM, which measures semantic consistency rather than geometric accuracy. Besides, no real polarimetric captures are evaluated. In the era of large foundation models, these results cannot show that the proposed method offers a clear advantage.
Questions for authors
- Please analyze how AoLP contributes beyond simple input fusion. For instance, show per-region error on reflective or texture-less areas. Also add the missing control that replaces the AoLP branch with normals predicted from RGB by an off-the-shelf estimator.
- Please evaluate on more complex objects and on real polarimetric captures. Also explain why the model underperforms its own backbone Step1X-3D in Chamfer Distance, and report geometry-focused metrics (e.g., normal consistency) in addition to CLIP-SIM.
Thank you for the author's detailed response and supplementary experiments.
Solved question: Compared with the LoRA baseline of only RGB, it better demonstrates the unique value of polarization information; The newly added indicators of surface distance and normal angle also address my concerns about local geometric quality.
There are still limitations: Although the new results have improved, compared to the original Step1X-3D, the Chamfer Distance is higher, which is still a trade-off. The generalization and robustness of this method in scenarios with different real materials, lighting conditions, and RGB AoLP registration deviations still require more quantitative experimental verification.