- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces U-AIM, a unified affective image manipulation task that jointly considers semantic and appearance editing under either user-specified or model-inferred emotional intents. The authors propose EGRA to integrate professional retouching data with affective semantic knowledge, constructing the UAIM-14K dataset and UAIMBench benchmark. Based on this supervision, they develop EmoWeave, a unified multimodal model that combines emotional intent inference, coordinated editing planning, and image editing. Experiments demonstrate strong performance in both planning quality and end-to-end affective editing compared with existing unified multimodal and emotion-specific editing baselines.
Critical strengths
1.The problem formulation is comprehensive and practically meaningful. U-AIM jointly models semantic- and appearance-level editing and provides a complete pipeline spanning training-data construction, benchmark development, and unified model training, offering strong practical value for affective image manipulation.
2.The experimental evaluation is comprehensive, with extensive baseline comparisons, component-wise ablations, and rich qualitative visualizations. These analyses provide a relatively thorough assessment of both the planning and editing capabilities of EmoWeave and make the effectiveness of the proposed framework intuitive and easy to understand.
Critical weaknesses
1.The single-reference evaluation in Scenario B may not fully match its autonomous intent-inference setting. Since a source image can plausibly support multiple emotional editing directions, evaluating against only one fixed target emotion with exact-match accuracy may underestimate valid predictions.
2.The end-to-end evaluation is limited to only 100 samples out of the 600-sample benchmark. Given the multiple scenarios, editing types, and emotion categories involved, the resulting per-setting sample sizes are relatively small, which may reduce the statistical power of the reported comparisons. Several EmoACC improvements are also statistically non-significant against strong general-purpose baselines.
Questions for authors
1.Can the authors provide direct human evaluation of the emotional responses elicited by the edited images? Since the current affective evaluation largely relies on EEmo-Logic and VLM judges, a human perceptual study would provide stronger evidence that the edits genuinely evoke the intended emotions.
2.To what extent do EmoWeave's gains come from EGRA/U-AIM rather than from the strong models used to construct the supervision, such as DeepSeek-V4-Pro and FireRed-Edit? An analysis comparing EmoWeave with its supervision generators would help disentangle the contribution of the proposed framework from teacher-model knowledge and biases.
3.Can the authors evaluate whether CAST and EGRA generalize to other UMM backbones or model scales? Since the current experiments use only SenseNova-U1.5-8B-MoT, additional backbone-level ablations would help establish whether the gains primarily come from the proposed method rather than backbone-specific properties.
4 comments
[Q] Response to rVKc Questions
Q1. Can you provide direct human evaluation of the emotional response to the edited images?
Thank you for this important question. We ran a human evaluation of planning quality and U-AIM Performance (Tab. R3). The baselines are representative general-purpose open-source models: Qwen3-VL-32B for planning and FireRed-Edit for editing. Planning quality is evaluated on 100 benchmark samples with 3 annotators each, with agreement 81.34% (Fleiss' κ ≈ 0.558). U-AIM Performance is evaluated in two steps. (1) Without a target hint, annotators see only the edited image and choose the dominant emotion from Ekman-6 plus Neutral (Human EmoACC). (2) In a blind pairwise comparison, they see the source image, the target emotion, and two randomly ordered results, and judge which conveys the target emotion better and which edit is more suitable overall.
Tab. R3. (a) Planning quality vs. Qwen3-VL-32B. (b) U-AIM Performance vs. FireRed-Edit (Tie: no preference).
| (a) Planner | Recommend Acc. (B) | State Grounding | Executability | Instruction Coherence |
|---|---|---|---|---|
| Qwen3-VL-32B | 43.18% | 70.33% | 41.00% | 72.00% |
| EmoWeave | 75.00% | 78.67% | 81.33% | 74.67% |
| (b) Method | Human EmoACC | Target-emotion preference | Overall editing preference |
|---|---|---|---|
| EmoWeave | 0.6900 | 62% | 58% |
| FireRed-Edit | 0.5800 | 28% | 30% |
| Tie | — | 10% | 12% |
Q2. How much of EmoWeave's performance comes from EGRA and U-AIM rather than from the strong models used to build the supervision?
Thank you for this constructive question. EGRA and U-AIM improve results beyond what DeepSeek-V4-Pro and FireRed-Edit provide. We examine the planning and execution sides in turn.
Planning side (DeepSeek-V4-Pro). DeepSeek-V4-Pro is text-only and writes instructions from textual state descriptions during data construction, so it cannot serve as an image-based planner baseline. 1) With the same DeepSeek generator, adding EGRA raises the top-ranked rate of the supervision from 22.9% to 39.7% under Gemini-3.1-Pro and from 14.8% to 46.6% under GPT-5.5 (Fig. 6, L428–431). 2) Planners trained on data built with EGRA recommend the target emotion more accurately and score higher in planning quality than planners trained on data built without EGRA (Tab. R4). 3) The planner is also substantially higher in planning quality than zero-shot planning by other multimodal models, including our base model (Tab. 3, L399–415). Together, these show the improvement comes from EGRA, not DeepSeek.
Tab. R4. Ablation study of EGRA.
| Training data | Recommend Acc. (B) | Overall Quality (B) | Overall Quality (A) |
|---|---|---|---|
| Without EGRA | 0.6742 | 0.7693 | 0.7621 |
| With EGRA | 0.7236 | 0.8121 | 0.7952 |
Execution side (FireRed-Edit). FireRed-Edit only generates the target images of the semantic training pairs, while the appearance pairs come from real photographers' retouching. EmoWeave is a unified model in which planning is as important as execution, so the fair comparison is on the whole task: with FireRed-Edit performing the end-to-end task, it trails EmoWeave on all four metrics (Tab. R5).
Tab. R5. End-to-end results on 200 samples (the same samples as Tab. R2(a) in our [W] reply).
| Method | EmoACC | Emo-S | Semantic | Appearance |
|---|---|---|---|---|
| FireRed-Edit | 0.5400 | 0.0598 | 5.9930 | 6.1038 |
| EmoWeave | 0.6500 | 0.1354 | 6.5500 | 6.7600 |
Q3. Do Capability-Aware Asymmetric Training (CAST) and EGRA apply to other unified multimodal model (UMM) architectures and model scales?
Thank you for this valuable question. EGRA and CAST are not tied to our backbone. EGRA builds its supervision independently of the model, and CAST only needs a unified model whose understanding and generation parameters can be updated separately. We further apply these two strategies to another UMM, BAGEL, and the results validate their effectiveness as they improve every metric over the BAGEL base model (Tab. R6). Planning quality is measured on the full benchmark and U-AIM performance on the 200 samples of Tab. R2(a) in our [W] reply.
Tab. R6. Experiments on BAGEL. (a) Ablation study of EGRA on planning quality. (b) Ablation study on U-AIM performance.
| (a) Setting | Recommend Acc. (B) | Overall Quality (B) | Overall Quality (A) |
|---|---|---|---|
| BAGEL (base model) | 0.5311 | 0.5413 | 0.5503 |
| + EGRA | 0.6594 | 0.6996 | 0.6812 |
| + EGRA & CAST | 0.6817 | 0.7421 | 0.7264 |
| (b) Setting | EmoACC | Emo-S | Semantic | Appearance |
|---|---|---|---|---|
| BAGEL (base model) | 0.5300 | 0.0517 | 5.8450 | 4.8100 |
| + EGRA | 0.5650 | 0.0734 | 5.9725 | 4.9875 |
| + CAST | 0.5850 | 0.0897 | 6.0775 | 5.6625 |
| + EGRA & CAST | 0.6050 | 0.1048 | 6.2125 | 5.8725 |
I appreciate the authors’ detailed response and additional experiments, which have alleviated some of my concerns. I am inclined to maintain my positive assessment.
We’re glad that we could address your concerns. Your feedback has clearly helped strengthen the paper. We truly appreciate it, thank you!
**[W] Response to rVKc Weaknesses**
W1. Does the single reference in Scenario B underestimate reasonable predictions?
Thank you for this insightful point. We recognize that emotion recommendation can have more than one reasonable answer, so we added human annotators for evaluation, and EmoWeave leads under this evaluation as well. Tab. R1 reports Recommend Acc. (B), which requires an exact match with the preset labels, and a version that counts any recommendation annotators find reasonable. The full human evaluation is in our reply to Q1 in [Q] and will be added to the main text.
Tab. R1. Human evaluation on emotion recommendation in Scenario B (human acceptance rates; 44 samples, 3 annotators each).
W2. How reliable are the end-to-end comparisons given the subset size?
Thank you for this constructive comment. We expanded the end-to-end evaluation from 100 to 200 samples, and EmoWeave keeps its lead over all baselines on all four metrics (Tab. R2). The 200 samples (Scenario A 111, B 89) are stratified-sampled from the 600 benchmark images by category and emotion, so they cover diverse image content (portraits, multi-person images, natural scenery, cities, animals, still life, macro scenes), enhancement and migration across different emotion directions, and all six emotions with a balanced distribution (Fig. 3, L282). Planning quality is evaluated on all 600 samples (Tab. 3).
Tab. R2. End-to-end results. (a) Scenario A + B, 200 samples. (b) Scenario A only, 111 samples; EmoEdit and EmoStyle require a user-specified target, so they are evaluated here.
On the expanded set, EmoWeave's EmoACC is at least 0.10 higher than that of every baseline (0.6500 against at most 0.5500). EmoACC is a top-1 hit rate, so it is the coarser of our two emotion metrics; Emo-S, the shift in the VER probability of the target emotion, separates the methods more clearly, at 0.1354 against 0.0598 for the best baseline.
The Questions are answered in a separate comment, [Q] Response to rVKc Questions. We sincerely thank you for supporting our work, and we hope our replies address your questions.