- Rating
- 4(+1)
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3(+1)
Read review
Paper summary
The author proposed a two-stage training pipeline (SFT + GRPO) to train an image editing planner to produce image editing instructions to improve the aesthetics of the image without large changes in the semantics.
Critical strengths
- The user study helps strengthen the claim and avoids circularity of using the same rubric for training and eval.
- The support for personalized APR is a useful new domain, and it respects the individual taste differences and could help avoid homogenizing the output.
- The semantic gate effectively limits the changes to the image and keeps the SFR high.
Critical weaknesses
One of the paper’s main claims, that text-based reward cannot capture feasibility, is never tested. It is possible the semantic gate (identity, clothing, physical scene, and key content) could be measured from the text space alone (eg if the text space says “replace the cloth with a red T-shirt”). The authors do not need to rerun the GRPO using text space, but a simple check could help strengthen the claim: use the generated pairs of images; use the image semantic gate as GT to test if an LLM can detect the same pattern in the text space with a prompt similar to “Could this editing instruction change the semantics of the image in [list of gates]”. Similarly, the aesthetics gain might also be able to infered from the text domain. I can think of two ways text-based reward could fail, and authors could include them in the motivation if the text-based reward has low agreement: 1. the image editing model is not perfect; it might change semantics when asking for non-semantic changes (for example, it might change the cloth every time you ask it to change the angle), using GRPO could teach the LLM to avoid these failure areas. 2. Some prompts might not seem to change semantically but would in practice, and using an image to verify is easier and more accurate (for example, asking the model to change the angle might seem like a non-semantic change, but it would because the model needs to outpaint some areas) This is my only concern for the paper and I am willing to raise my score if this is solved. It is fine if the evidence cannot support that image-level reward is necessary, as long as the authors tighten the claim.
Questions for authors
See weaknesses. Could the author provide a small test comparing image and text space reward?
4 comments
(2/2) Response to Reviewer 8qDA
3. Why Text-Based Rewards Fail
-
Analysis: Building on the reviewer's insightful observations, we further illustrate two reasons why text-based rewards can fail:
- (1) Limited editor capabilities: Current image editors may struggle to understand or execute complex photographic instructions. For example, FLUX.2 often fails to follow "Set the bottom edge of the frame just below the woman's feet," but responds better to "Reframe as a full-body portrait, with both feet fully visible." Similarly, "Shoot from a high angle" often produces an excessively steep viewpoint, while "Slightly raise the camera viewpoint" better achieves the intended adjustment. Such failures depend on the editor's capabilities and limitations, and cannot be reliably predicted from textual instructions alone.
- (2) Unintended semantic changes: Even seemingly reasonable instructions, such as changing the camera viewpoint, may require generating previously unseen background regions based on the editor's learned scene priors. For example, when changing the viewpoint of a portrait taken outside a café, the editor may introduce tables and chairs based on typical café layouts, even if they were absent from the original scene. These outcomes are difficult to predict from textual plans alone.
-
Solution: APR requires the planner not only to determine how to improve photographic aesthetics, but also to ensure that the editor can execute these changes accurately and appropriately. Accordingly, Harmonia's planner provides professional aesthetic reasoning, while VA-GRPO uses actual visual feedback to improve aesthetic planning and adapt to the editor's capabilities and limitations. This enables the planner to learn executable reconstruction plans that achieve aesthetic gains while preserving semantic consistency. We will incorporate this analysis into the final paper.
My concerns are resolved, I will raise my score
Response to Reviewer 8qDA's Follow-up Comment
Thank you for your constructive feedback and positive response. We are glad that our additional experiments and analysis have addressed your concerns. We will incorporate these results and the corresponding analysis into the final version of the paper.
(1/2) Response to Reviewer 8qDA
Thank you for your valuable comments. Following your suggestion, we conducted two experiments to test whether predictions from the reconstruction plan (without the edited image) can replace (1) semantic feasibility checks and (2) visual aesthetic reward evaluation.
1. Text-Based Predictions Cannot Replace the Visual Semantic Gate
Experiment: To test both (1) violation detection and (2) preservation of feasible edits, we sample 2,000 infeasible reconstructions (500 per violation category: Identity, Clothing, Physical Scene, Key Content) and 2,000 matched feasible reconstructions. From the original image and plan, each model predicts the same four 1–5 scores as the visual Gate, using the image-based Gate decisions as GT.
Metrics:
Conclusion: Balanced Accuracy is only 55.48%–57.10%, near chance (50%). Qwen3.7-Plus incorrectly accepts 72.05% of actual violations; GPT-5.6 detects more violations but incorrectly rejects 73.15% of feasible edits. On additional 4,799 naturally distributed rollouts sampled to preserve the original feasibility distribution, Balanced Accuracy remains only 58.64%/57.68%. Identity/Clothing violation miss rates on this set are 98.18%/94.08% (Qwen3.7-Plus) and 87.27%/81.58% (GPT-5.6), indicating that both struggle to detect violations. Thus, text-based predictions cannot reliably detect semantic violations while retaining feasible edits; they cannot replace the visual Gate.
2. Text-Based Predictions Cannot Reliably Estimate Visual Rewards
Experiment: We sample 600 complete 8-rollout groups (4,800 edits, all passing the visual Gate), stratified by early/middle/late training steps and Default/Personalized tasks. Using only the original image and plan, both models predict R1 (Structural Gain), R2 (Final Aesthetics), R3 (Intent Satisfaction), and their combined reward, against image-based GT. We also test 600 naturally distributed 8-rollout groups containing feasible and infeasible edits: predict the Gate first, then rewards, to reconstruct VA-GRPO's final reward and ranking.
Metrics: Pairwise Accuracy measures correct ordering of candidate pairs within each 8-rollout group (50% random baseline); Spearman measures predicted–GT rank correlation (0: none; 1: perfect). We also report Top-1 Accuracy (selecting the best of eight) and MAE (average absolute score error) in the discussion below.
Conclusion: R1/R2 pairwise accuracy is only 48.84%–51.91% (50% random). For R2, Spearman is negative for both models, showing that predicted scores fail to track actual aesthetic quality; MAEs are 12.03/19.84 points (out of 100). Selecting the best-looking edit among eight succeeds only 11.83%/12.17% of the time (12.50% random). Although R3 retains some intent signal (~59% pairwise), combined rewards reach just 52.80%/52.77%. On the naturally distributed groups, jointly predicting Gate and rewards yields only 52.60%/50.52% final-reward pairwise accuracy (50% random) and 15.00%/13.50% Top-1 accuracy (12.94% random). Thus, text-based predictions cannot reliably rank actual edits or provide the aesthetic reward signal needed by VA-GRPO.
These results confirm Harmonia's motivation: a text plan specifies intended edits, not their realized semantic changes or aesthetic quality. VA-GRPO therefore evaluates actual edited images for both feasibility and reward optimization.