- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Partial Complementary Policy Distillation (PCPD) for evaluating AI-generated images across aesthetics, lighting, shadow, and realism. It trains two experts on overlapping subsets of these dimensions, separating aesthetic and shadow supervision while retaining lighting and realism in both. The shadow expert uses visual tools and self-generated checking rules during training. After a tool-use internalization step, the experts exchange their complementary capabilities through dimension-masked mutual on-policy distillation. A final joint optimization stage produces a single evaluator that does not require external tools. The authors also introduce AIGC-IQA-Bench, containing 10,000 images with human ratings, and report improved correlations with human judgments on this dataset, AGIQA, and PIPAL.
Critical strengths
The paper studies a useful distinction between visual appeal and local physical plausibility. Table 4 shows that joint training can reduce aesthetic and shadow performance relative to separate training, which gives the proposed specialization strategy an empirical motivation. The four-dimensional annotations in AIGC-IQA-Bench could also provide a useful resource for studying errors that an overall quality score would obscure. The reported results show an improvement in shadow assessment without sacrificing aesthetic performance. In Table 2, PCPD raises shadow PLCC from Q-Probe’s 0.683 to 0.821, while aesthetic PLCC increases from 0.848 to 0.866. Table 6 also shows complementary strengths in the two experts and improved performance in the final unified model. These results support the practical value of the training pipeline, even though they do not fully establish its proposed mechanism.
Critical weaknesses
The evidence for resolving gradient conflict is weaker than the paper’s central claim. Table 1 diagnoses conflict at selected points during standard joint training, but the paper does not provide comparable measurements after PCPD or during the final four-dimensional GRPO stage. Restricting distillation losses to selected output tokens does not, by itself, establish that gradients in shared parameters no longer interfere. The performance gains are encouraging, but they cannot distinguish conflict reduction from other benefits of specialization and additional supervision. This matters because resolving dimensional conflict is presented as the main methodological contribution. Although the appendix reports further distillation ablations, the current evidence does not establish how much of the gain requires the proposed complementary distillation scheme rather than the broader, more expensive training pipeline. This leaves the added value of the central design uncertain.
Questions for authors
1.Could the authors provide gradient-conflict measurements comparable to Table 1 before and after PCPD, including during the final joint GRPO stage? Does interference between aesthetics and shadow remain lower when all four rewards are optimized together? This would help determine whether the proposed mechanism explains the observed gains. 2.Which baselines were trained on the same images and human annotations as PCPD, and how were their training budgets determined? Is there a comparison with joint training or a simpler distillation pipeline under a comparable compute budget? Such a comparison would materially affect my assessment of the added value of complementary distillation. 3.In Section 3.2, does masking tool calls and returned observations mean removing them from the model’s input context, or only excluding them from the SFT loss? Please clarify the conditioning information used in this stage and report Model α’s shadow performance immediately before and after conversion to tool-free inference. This would help assess whether the capability needed by the subsequent distillation stage is preserved.
Rebuttal Revision Uploaded.
Dear Reviewer,
We have responded to all the questions raised in the rebuttal, revised the PDF, and submitted a Rebuttal Revision version of the PDF. The newly added content is marked in blue. If the paper is fortunately accepted, we will remove the blue markings. If unfortunately it is not accepted, we will incorporate the reviewers’ comments in our subsequent submission.
If you have any other questions, please feel free to raise them. However, due to time constraints, we would appreciate it if they could be raised as soon as possible. If there are no further questions, we sincerely hope that the reviewers can consider raising the score. Thank you very much.