- Rating
- 4
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Latent Aesthetic Deliberation (LAD), a recurrent framework for image aesthetic assessment that refines aesthetic judgments in latent space without requiring explicit chain-of-thought annotations or textual reasoning during inference. After a single multimodal encoding pass, LAD maintains persistent image-token memory and iteratively updates a compact latent judgment state by repeatedly retrieving and integrating visual evidence. The model is trained using human mean opinion scores together with internal self-distillation to supervise intermediate score predictions, and the final aesthetic score combines the recurrent regression output with a language-aligned rating estimate. Experiments on AVA, PARA, AADB, and ICAA17K show strong performance for both holistic and aspect-specific aesthetic assessment, with ablations supporting the effectiveness of recurrent visual evidence retrieval and intermediate trajectory supervision.
Critical strengths
-
LAD introduces a well-motivated latent deliberation mechanism that iteratively refines aesthetic judgments without requiring explicit CoT annotations or costly textual reasoning at inference.
-
The combination of persistent visual memory, recurrent evidence retrieval, and intermediate self-distillation is technically coherent and allows the model to learn multi-step judgment refinement using only final human MOS supervision.
Critical weaknesses
- The paper repeatedly frames the recurrent process as deliberation, reasoning, and judgment refinement, but the supervision does not actually establish a reasoning process. Intermediate steps are only encouraged to match the final prediction, which itself is supervised by the MOS, so the method may simply perform iterative feature refinement or repeated score calibration rather than meaningful aesthetic reasoning. The current evidence does not convincingly distinguish these interpretations.
Questions for authors
-
Could the authors evaluate LAD on more diverse or out-of-domain aesthetic benchmarks, such as VAB [1] and AesBench [2]? In particular, VAB is grounded in expert consensus, so I would be interested in whether the gains on conventional MOS-based benchmarks transfer to expert-aligned aesthetic judgment.
-
The final score is computed as . Is there a clear ablation comparing the classification branch alone, the recurrent regression branch alone, and their fusion, as well as sensitivity to the fusion weight ? Otherwise, it is difficult to tell how much of the gain comes from LAD itself versus the score fusion, and why is the appropriate choice.
-
The paper describes the recurrent process as deliberation and judgment refinement, but the intermediate states are only supervised to match the final prediction. Is there additional evidence that these steps capture meaningful aesthetic reasoning rather than simply iterative feature refinement or score calibration?
[1] https://arxiv.org/abs/2605.12684 [2] https://arxiv.org/abs/2401.08276
3 comments
Thank you for the detailed response and the additional experiments. Although some of the improvements are relatively modest, I believe the new evidence sufficiently supports the overall claims of the paper and addresses my main concerns. I appreciate the authors' efforts and will raise my score accordingly.
Thank You for Your Reply
Thank you for carefully considering our response and additional experiments. We appreciate your positive reassessment and are glad that the new evidence addresses your main concerns. Your constructive feedback has helped us strengthen the paper, and we sincerely appreciate the time and care you have devoted to reviewing our work.
Response to Reviewer De7Y
Response Summary: We thank the reviewer for recognizing LAD's motivation and coherent design. The constructive feedback has helped us improve the presentation and strengthen the empirical evidence. We address the concerns with additional mechanism interventions, zero-shot VAB evaluation, and fusion analyses, while clarifying the evidence supporting aesthetic deliberation.
Q1: Evaluation beyond MOS-based benchmarks
We evaluated LAD on VAB without additional training, following its individual-image scoring protocol: average three scores per image, then select the highest- and lowest-scoring images within each candidate set.
LAD improves over Q-Align by 1.15%, 0.84%, and 1.57%, respectively, and leads Top-1/TB-1 among these scorers, providing evidence of transfer to expert comparative judgments. Our AesBench access request remains pending. If access arrives in time, we will evaluate LAD and update the results. Both benchmarks are discussed in the revised manuscript.
Q2: Branch contributions and fusion weight
We compared regression-only scoring with two fusion weights on VAB, using s^=γscls+(1−γ)sreg (Supplementary PDF E.3.1, Table 10).
Default fusion improves Top-1/TB-1 over regression-only scoring by 2.13%/2.65%, while Bot-1 decreases by 0.1 percentage point. Compared with classification-only scoring, it improves Bot-1 by 0.7 percentage points, while Top-1/TB-1 decrease by 0.7/1.0 percentage points. These results reveal a trade-off between best- and worst-image selection across the two branches and their fusion.
Why γ=0.3. The rating branch converts aesthetic-level probabilities into a language-aligned score. The recurrent branch learns fine-grained judgment updates through visual evidence integration and direct MOS supervision. We set γ=0.3 across datasets with no purposeful search. We aim to prioritize the recurrent prediction while retaining rating information.
W1 & Q3: Evidence for aesthetic deliberation
Score consistency alone does not establish aesthetic reasoning. Final MOS regression backpropagates through the complete recurrence. Self-distillation aligns intermediate scalar readouts with the detached final prediction, without requiring latent representations to match. The evolving state carries information into subsequent visual queries. Scalar scores are readouts, not feedback inputs.
We tested intermediate-state interaction and continued visual access through two inference-time interventions on PARA, preserving the normally computed first-step state and intervening from step 2 onward.
The first blocks the score token from attending to thought tokens during self-attention, retaining its own state and direct visual-memory access. The decrease supports the contribution of thought-to-score information transfer.
The second zeros subsequent visual cross-attention updates for all tokens, retaining initialization and first-step information as well as later self-attention, feed-forward, and gated updates. Accuracy decreases despite continued latent processing, supporting the contribution of renewed visual access. Details are in Supplementary Appendix H.5, Table 18.
These results complement Figures 3 and 4: Figure 3 shows regression-score revisions toward MOS in selected examples. Figure 4 depicts changing visual-memory attention across steps. The figures describe how predictions and retrieval evolve. The interventions show that disrupting these information pathways reduces the trained model's accuracy. Full-test-set trajectories also reflect dataset-level statistics on reasoning process (Supplementary Appendix G.3, Table 14). Together, these findings support learned, visually grounded aesthetic judgment refinement through state interaction and continued evidence integration.
Closing: We thank the reviewer again for helping us clarify LAD's mechanism and strengthen its supporting evidence.