- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses a meaningful problem in the task of 3D texture generation by proposing a two-stage post-training framework. Specifically, existing post-training methods for 3D texture generation use 3D-asset-level rewards/signals to improve the texture of a 3D asset. However, the authors argue that this may not be the best way to reward texture quality because, in a view-by-view texture generation approach, each painted view may have a different quality, and rewarding the entire 3D asset cannot capture these differences. To address this issue, the authors propose evaluating the texture by assigning a credit/reward to each individual viewpoint that contributes to the final texture. To this end, they first construct a dataset of human preference pairs between corresponding views to train a reward model. Then, using this trained reward model, they leverage an existing online post-training approach, DiffusionNFT, to guide the policy model (the texture generation model) toward generating textures that achieve higher scores according to the view-level reward model. Through quantitative and qualitative experiments as well as a user preference study, they demonstrate the effectiveness of their approach and show that the proposed post-training framework can generate textures with more detailed and clearer appearances for 3D assets compared to existing methods.
Critical strengths
-
The problem addressed by this paper is a critical and important one in texture generation: evaluating texture quality during post-training based only on the final textured/painted asset cannot properly capture the quality differences between the views used to generate the final texture. Yet, many existing post-training approaches for texture generation rely on 3D-asset-level evaluation.
-
The paper is well-written and easy to follow.
-
The constructed human preference texture dataset and the trained reward model could be valuable to the 3D community for further research, even beyond the online post-training approach leveraged in this work, given that the authors make the dataset and reward model checkpoint publicly available.
-
The method verifies the effectiveness of such per-view constructed and trained reward models by applying them to an existing online post-training method.
Critical weaknesses
-
In the contribution bullet points in the Introduction, evaluating the reward model and the post-training framework is listed as one of the contributions of this work. While this evaluation is valuable and I appreciate the authors’ efforts in conducting it, I do not consider it a contribution in itself. In fact, evaluation is a required component of any research paper as it allows the community and audience to assess the paper’s position compared to existing work in the field. Therefore, I strongly recommend removing this item from the contribution bullet points.
-
Throughout the paper, especially in Sec. 3.3, the proposed post-training framework is presented as if DiffusionNFT were proposed by this paper. However, based on my understanding of Sec. 3.3, almost all the mathematical formulations and the overall approach appear to be identical to those presented in the original DiffusionNFT paper (with the exception, of course, of the per-view formulation of DiffusionNFT). The authors should clearly explain the main modifications and contributions they make to the DiffusionNFT approach. Otherwise, the current presentation gives the impression that all the mathematical formulations in Sec. 3.3 are proposed by this paper, which is not the case. I understand that one of the main contributions of this work is applying the DiffusionNFT post-training approach to view-level-credited post-training for 3D texture generation, rather than image generation, which was the primary focus of DiffusionNFT. However, even this distinction is not sufficiently clear in the current version of Sec. 3.3. Overall, I recommend presenting the mathematical formulations and methodology inherited from DiffusionNFT in a preliminary section, followed by a clear explanation of the modifications and how DiffusionNFT is adapted to the 3D texture generation task. This would help readers clearly distinguish between the contributions of the original DiffusionNFT paper and those of the current work.
-
Although the paper is properly evaluated and analyzed through quantitative experiments and a user preference study, and the existing qualitative examples in Figure 4 are mostly convincing, I believe it would be worthwhile to include more qualitative examples and comparisons with the baselines, either in the main paper or in the appendix. These examples could demonstrate the differences across a wider range of mesh geometries, topologies, and texture patterns.
-
Minor comments:
-
In the Introduction and Appendix, the Bradley-Terry model is mentioned but not cited. I recommend adding the appropriate citation, along with a brief explanation of the intuition and mathematical formulation behind the Bradley-Terry objective function, which is widely used in RLHF.
-
In Equation (1), $ \mathcal{F}_{\theta} $ is not defined and is never used again. I assume this refers to the multi-view 3D texture generation model, which is also considered the policy model in the DiffusionNFT approach, particularly in Equation (14). Is this correct? If so, please use consistent notation throughout the paper.
-
Questions for authors
-
Is there any specific theoretical or practical contribution to DiffusionNFT that was necessary to make the proposed approach work? To be precise, as I also pointed out in the weaknesses above, I understand that the proposed method applies DiffusionNFT to the 3D texturing task using the proposed per-view reward model. However, I am specifically asking whether any theoretical or practical novelty has been introduced to the post-training optimization framework itself. I would appreciate clarification from the authors on this point as it would help reveal the actual novelty of the proposed method on the post-training optimization side.
-
Could the authors clarify how the reference images and input mesh geometries shown in Figure 4 were obtained and what their sources are? I could not find this information in the paper. Based on my observations, it seems that the reference images might be renderings of textured meshes from a frontal view (obtained from a texture generation model). I may be wrong about this, but in all the examples in Figure 4, the geometric details of the objects appear to be identical in both the reference images and the input meshes. If this is the case, what is the rationale behind using such reference images? More importantly, what would happen if the reference image were generated by an image-generation model and the input mesh came from a different source? In this scenario, the geometry of the object depicted in the reference image might differ from that of the actual mesh to be textured. I would expect such a discrepancy to potentially cause the proposed method to fail or produce suboptimal results. I may be mistaken in this assumption and so I would appreciate clarification from the authors on this point particularly regarding the method's robustness to geometric discrepancies between the reference image and the input mesh.
8 comments
M1. Bradley–Terry citation and intuition. We have added Bradley and Terry (1952) to the references and cited it in the Introduction and alongside the preference-learning objective in Sec. 4.2. We also explain that models the probability of choosing the preferred candidate over the rejected one. Minimizing its negative log-likelihood encourages a higher score for the preferred candidate, allowing learning from pairwise judgments without requiring absolute quality ratings.
In the revised manuscript:
- Introduction, p. 2: Added the Bradley–Terry citation.
- Sec. 4.2, pp. 5–6, Eq. (11): Cited the original work and explained the preference probability and negative log-likelihood objective.
- References, p. 11: Added the bibliographic entry for Bradley and Terry (1952).
M2. Definition of the generator notation. Thank you for pointing this out. denotes the multi-view diffusion generator parameterized by , which is the generation policy optimized during post-training. We have added this definition immediately after the generation equation, now Eq. (4), on p. 4. The notation used in the DiffusionNFT formulation denotes this policy's prediction at a noisy input and timestep, whereas denotes the overall conditional generation mapping. The sampling policy uses the corresponding parameters , as clarified in Sec. 4.3.
In the revised manuscript:
- Sec. 4.1, p. 4, Eq. (4) and line 196: Defined the multi-view diffusion generator .
- Secs. 3 and 4.3, pp. 4 and 6–7: Specified the trainable and sampling policies used in post-training.
Q1. Contribution on the optimization side. Our contribution is a view-level credit-assignment modification within DiffusionNFT, rather than a new branch construction or a new optimization algorithm. A per-view reward model alone does not ensure per-view supervision during optimization: aggregating its outputs into one trajectory-level advantage still broadcasts the same preference feedback to every view. We instead normalize rewards across candidates at each fixed viewpoint and retain the resulting view-specific weights in the regression objective.
We have added an objective decomposition in Sec. 4.3 (p. 7, Eq. (16)) to explain how view-level weighting differs from assigning a shared weight to all views. Writing the branch losses as and the mean view weight as , we express the objective as
Here, is a shared-weight counterpart constructed using , with the remaining terms unchanged. The additional term retains within-candidate differences and modulates how each view contributes to the shared parameter update. It vanishes when all view weights within a candidate are equal.
The existing ablation in Sec. 5.5 and Fig. 6(a) compares this formulation with trajectory-level aggregation and advantage averaging. Over the 250-step training run shown in Fig. 6(a), both shared-feedback alternatives exhibit a sharp reward decline in the later stages, whereas view-level weighting continues to improve.
In the revised manuscript:
- Sec. 3, p. 4: Separated the inherited DiffusionNFT components from our modifications.
- Sec. 4.3, pp. 6–7, Eqs. (14)–(16): Presented view-specific weighting and an algebraic decomposition explaining its effect.
- Sec. 5.5 and Fig. 6(a), p. 10: Provided the supporting ablation of view-level weighting, trajectory-level aggregation, and advantage averaging.
Q2. Input sources and robustness to reference–geometry mismatch. Thank you for asking us to clarify the input sources. The reference images in Fig. 4 are generated by image-generation models. The input meshes are subsequently reconstructed from those images using a pretrained image-to-3D geometry generator that was not publicly available at submission. Thus, the reference images are not obtained by rendering the final textured meshes. Their geometric similarity arises from conditioning mesh reconstruction on the reference image, which provides a coherent image–shape pair for the texturing task.
We have also added a mismatch study in Appendix K (p. 21) that keeps the original crowned-lion texture reference fixed and pairs it with three meshes: a decorated lion with local structural differences, a lion without accessories, and a standing tiger. These meshes are reconstructed from modified images using the same geometry generator.
Fig. 15 compares MV-Adapter before and after CrediTex post-training. In the illustrated examples, CrediTex reduces misplaced colors on the back of the cape and spurious decorative patterns on the soles, showing that its benefits persist under the tested discrepancies. These results provide qualitative evidence that CrediTex retains its benefits under the tested reference–geometry mismatches.
In the revised manuscript:
- Sec. 5.3, p. 9: Clarified how the reference images and meshes in Fig. 4 were obtained.
- Appendix K, p. 21: Described the construction and analysis of the reference–geometry mismatch cases.
- Fig. 15, p. 24: Compared MV-Adapter before and after CrediTex under three mismatch settings.
Thank you for recognizing the importance of view-level texture evaluation and the potential value of our dataset and reward model. We have revised the contribution statement, separated the inherited DiffusionNFT formulation from our modifications, and added qualitative comparisons and a reference–geometry mismatch study. Below, we provide clarifications and additional results for each of your comments and questions in turn.
W1. Evaluation as a contribution. We agree and have removed evaluation as a standalone contribution. The revised list focuses on three components: the human view-level preference dataset, the context-aware per-view reward model, and the view-level credit-assignment scheme built on DiffusionNFT. Experiments are presented as evidence supporting these components. The revised contributions are reproduced below.
In the revised manuscript:
W2. Distinguishing inherited DiffusionNFT components from our modifications. Thank you for pointing out the ambiguity in the original presentation. We have added Sec. 3, “Preliminaries: DiffusionNFT,” to introduce and attribute the underlying framework before presenting our method. We explicitly retain DiffusionNFT's positive/negative branch construction and regression mechanism. The EMA sampling-policy update and timestep-weighting mechanism are also inherited rather than claimed as new contributions.
Sec. 4.3 now focuses on our modification: rewards are normalized across candidates independently at each fixed viewpoint, and the resulting weights are applied to the corresponding view losses. The generator still processes the full multi-view input jointly. Thus, a candidate no longer has to receive the same preference feedback at every view.
We also added Eq. (16), which decomposes the view-weighted objective into a shared-weight NFT counterpart and a term capturing within-candidate view-weight deviations. This makes the difference explicit without reattributing the underlying optimizer to our work.
In the revised manuscript:
W3. Broader qualitative comparisons. We have added six examples comparing MV-Adapter before and after CrediTex post-training across a wider range of geometries, topologies, and texture patterns. Each example shows the reference image and all six output views, with red boxes highlighting local differences.
In the illustrated cases, CrediTex reduces misplaced patterns and color artifacts on less-visible surfaces, such as the chair's underside and the back of the interlocking rings, while better preserving the dragon's wing colors and the rope's braided pattern. These examples supplement the stylized and realistic characters, text-bearing objects, and architecture already shown in Fig. 4.
In the revised manuscript: