- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the problem of residual lighting and shadows in textures generated for 3D assets and proposes a delighting framework combining Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). The method first trains a texture generation model using multi-view normal maps and reference images to establish basic delighting capabilities. The authors then develop reward models that evaluate both delighting quality and content consistency, and further optimize the generated results through reinforcement learning. In addition, the paper introduces an exploration reward and a stage-aware multi-objective optimization strategy, along with a dedicated dataset and evaluation framework. Experimental results demonstrate significant improvements in delighting performance and image fidelity.
Critical strengths
(1) The research problem has practical significance. Residual lighting in generated 3D assets can negatively affect subsequent relighting and scene editing. This paper addresses this issue with a dedicated optimization framework, offering clear practical value. (2) The reward design is well motivated. The authors separately model delighting quality and content consistency, accounting for the trade-off between shadow removal and preservation of the original textures. The ablation studies also demonstrate the effectiveness of consistency constraints in mitigating color shifts and texture degradation.
Critical weaknesses
(1) The technical contribution is not sufficiently clear. The framework combines multi-view SFT, Flow-GRPO, reward modeling, and stage-aware optimization, but the main methodological novelty beyond task-specific integration is not clearly established. The exploration reward is relatively simple, and the stage-aware scheduling appears largely heuristic.
(2) The necessity of reinforcement learning is not sufficiently demonstrated. Although the paper shows clear improvements over the SFT baseline, the RL stage also introduces additional reward supervision. It is therefore difficult to determine how much of the improvement specifically comes from online reinforcement learning.
(3) The generalization of the proposed framework could be further validated. The experiments are mainly conducted with a Hunyuan-3D-style texture generation pipeline and a relatively fixed asset/rendering setting. It would be valuable to evaluate whether the proposed RL strategy and reward design can generalize to other 3D generation pipelines, more diverse asset categories, complex materials, and different lighting conditions. The current results are promising, but broader evaluation would strengthen the practical significance of the method.
Questions for authors
No
7 comments
### W1. Methodological contribution and the exploration/scheduling mechanisms
Reviewer comment (excerpt):
The technical contribution is not sufficiently clear. The framework combines multi-view SFT, Flow-GRPO, reward modeling, and stage-aware optimization, but the main methodological novelty beyond task-specific integration is not clearly established.
Thank you for asking us to clarify the methodological contribution. Our design addresses two optimization issues in 3D delighting: exploring beyond the SFT solution without relying solely on stronger sampling noise, and balancing illumination removal against visual-quality preservation.
(1) Dedicated exploration
Flow-GRPO introduces stochasticity through SDE sampling. Our exploration reward provides an additional incentive based on latent-state variation, rather than using increased noise as the sole mechanism for exploration. The reward supplies a complementary optimization signal without requiring another learned evaluator. Figure 5 compares Flow-GRPO + R_de with our method at low, medium, and high noise levels, including both training and evaluation curves. It illustrates the tradeoff that higher noise can improve training reward without a corresponding evaluation gain. Figure 1 and supplementary Figures 16–20 also compare the full method with w/o exploration, whose displayed trajectories retain residual lighting.
(2) Stage-aware objective scheduling
A fixed weighted sum exposes the model to both objectives simultaneously, even when their optimization effects differ across generation stages. Our scheduling uses a stage-dependent signal to select the objective, with CLIP variation serving as a proxy for the transition in the generation process. The intent is to balance delighting and visual quality through the timing of their optimization.
(3) Additional Fixed-Sch ablation
The original Figure 6 already compares our method with single-objective optimization and weighted MORL under both PickScore and Aesthetic Score. We have now also evaluated Fixed-Sch. Its fixed switching point is the mean switching point observed over the complete adaptive training run, and the same value is used in every epoch. Figure 6(a,b) shows the extended comparison. In the PickScore setting, Ours reaches a higher PickScore while attaining a similar late-stage delighting reward. In the Aesthetic Score setting, Ours reaches higher late-stage aesthetic and delighting scores than the tested fixed schedule. These results support the value of adaptive scheduling relative to that fixed-switching configuration.
The two mechanisms have complementary roles: exploration supports optimization beyond the initial solution, while scheduling balances delighting and visual quality. The ablations and Fixed-Sch comparison support these roles.
Revision location: Section 4.3 (scheduling ablation analysis) and Figure 6(a,b) (fixed schedule comparison); existing Figures 1 (exploration ablation trajectories), 5 (sampling noise comparison), and 16–20 (exploration–consistency ablations).
### W2. Online RL versus additional reward supervision
Reviewer comment (excerpt):
Although the paper shows clear improvements over the SFT baseline, the RL stage also introduces additional reward supervision. It is therefore difficult to determine how much of the improvement specifically comes from online reinforcement learning.
The RL stage performs reward-based post-training for delighting. SFT provides the initial policy, and the reward supplies feedback for illumination removal and appearance preservation.
(1) Motivation for reward-based post-training
This formulation follows established work on optimizing diffusion and flow-matching models with rewards, including DDPO and Flow-GRPO. DDPO also compares policy optimization with reward-weighted likelihood methods in its image-generation tasks, providing relevant motivation for our choice of optimization framework.
(2) Questions addressed by the comparisons
Our SFT–Ours comparison evaluates the complete reward-based post-training stage. SSIM increases from 0.8465 to 0.9063, PSNR from 22.34 to 27.48, and L2 decreases from 0.1128 to 0.0514. Figure 3 additionally compares our method with Flow-GRPO + R_de, which also uses the delighting reward, evaluating our optimization design with the same task reward.
These comparisons address two questions: SFT–Ours measures the complete reward-based post-training gain, and Flow-GRPO + R_de–Ours evaluates the optimization design under the same task reward. Which alternative reward-use scheme would the reviewer consider most relevant for further comparison?
Revision location: Section 2.2 (reward-based post-training), Section 4.2 (two comparison settings), Figure 3 (same-reward optimization comparison), Table 1 (post-training over SFT).
We Sincerely Appreciate Reviewer M1Z2’s Positive Assessment and Support
We sincerely thank Reviewer M1Z2 for the positive evaluation of our work and for recognizing the practical significance, reward design, and experimental effectiveness of our method. We have made every effort to address all of your concerns in detail, and if you find our responses satisfactory, we would greatly appreciate your consideration of a higher score; if you have any further questions, please feel free to raise them and we will respond promptly.