- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies RL post-training for a two-stage image-to-3D generator, focusing on its VoxSet-based refinement model. It introduces an Implicit Latent Reward Model (I-LRM) that reuses the first eight blocks of a pretrained DiT together with a learned reward head. Preference labels are constructed automatically by ranking VAE reconstructions obtained at different latent granularities. The proposed HRPO pipeline combines this latent score with ID-Sim and DINOv3 similarity scores computed between the input image and a rendering from the corrected conditioning-camera view. It then applies Flow-GRPO-style updates with regularization against a frozen reference policy. The evaluation includes held-out synthetic preference pairs, three image-shape alignment metrics on 90 test images, reward-component ablations, and user studies. The full system improves over the pretrained model on all three reported alignment metrics.
Critical strengths
1.The reward design addresses a genuine ambiguity in single-image 3D generation. By treating observed-view consistency and learned whole-shape preferences as complementary sources of supervision, the method avoids imposing a single reference completion on unobserved regions.
2.The full method improves Uni3D, OpenShape, and ULIP-2 scores over the pretrained model and outperforms both single-reward variants on all three metrics.
Critical weaknesses
1.Although the paper describes camera correction using recorded camera parameters, how does the explicit reward handle residual pose misalignment between the generated mesh and the reference image? Moreover, this reward evaluates the rendered image as a whole and may not direct optimization toward local defects. For example, if an owl mesh has poorly reconstructed toes, the reward could increase by further improving the already reasonable feathers without correcting the toes. This could lead to a mismatch with human judgments.
2.The central claim about the learned reward has not been sufficiently validated beyond the process used to generate its labels. Section 3.2 defines the preferred samples through VAE reconstruction granularity, while Section 4.2 evaluates on held-out pairs produced by the same procedure. The reported accuracy of 88.12% therefore establishes agreement with this proxy labeling rule, but does not necessarily demonstrate reliable quality rankings of actual generator outputs. In addition, the human evaluation protocol needs further clarification, including the number of participants and the blinding procedures, so that its fairness and reliability can be assessed.
Questions for authors
1.How does the explicit reward handle residual pose misalignment between the generated mesh and the reference image, even after camera correction? Since it scores the rendered image as a whole, how does it guide optimization toward local defects, such as poorly generated fingers?
2.Were the source meshes split into training and held-out sets before VAE reconstruction and pair construction, ensuring that the 1,000 held-out pairs contain no source meshes used to train I-LRM? What granularity settings were used, and how were token counts and voxel support handled at scoring time? Can you evaluate I-LRM's agreement with independent human judgments on actual policy-generated pairs while controlling for granularity-related cues, and assess visible-view consistency separately from whole-shape quality?
3.Clarify the provenance of the 90 test images and their separation from the training data. For Figures 8 and 9, provide the complete evaluation protocols and the numbers of inputs and judgments underlying the reported results, including the number of raters, task assignment, presentation order, blinding procedures, and views shown to participants.
4.Equation (9) follows Flow-GRPO, whereas Table 5 compares online hybrid-reward training with offline DPO trained on granularity-derived preferences without the hybrid reward. How much of the improvement can be attributed to the optimization algorithm itself, rather than to differences in feedback or online data collection?