- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies sensation understanding and generation in advertisements. It introduces hierarchical sensation annotations and trains SenseScore using CPO with a hierarchy constraint to improve agreement with human judgments. It also proposes SAGA, a Planner–Prompt Refiner–Evaluator framework for iteratively generating and editing advertisements to convey intended messages and sensations.
Critical strengths
- The paper offers a valuable perspective on advertisement generation by examining sensory evocation alongside message alignment.
- The dataset provides detailed hierarchical sensation annotations for 1,100 advertisements, approximately 700 of which are used for training.
- Table 2 provides useful evidence for the scoring method: overall Cohen’s κ increases from 0.33 with SFT to 0.57 with CPO and 0.69 with CPO plus the hierarchy constraint.
Critical weaknesses
- The contribution of individual SAGA components is unclear. Table 3 compares the complete system against generation baselines, leaving the benefits of planning, prompt refinement, editing, and evaluator feedback unresolved. The authors should clarify whether SenseScore itself is used in the generation loop and provide ablations without evaluator feedback and without its sensation-specific feedback.
- Stronger prompting baselines are needed. The shared action–reason and sensation template is a reasonable task specification, but a baseline that expands it into a detailed visual prompt would help establish the additional value of SAGA. Comparisons using the same generator and editor under comparable computational budgets would further strengthen the evidence.
- Iteration behavior is insufficiently documented. Please report the maximum and typical numbers of iterations, stopping criteria, and computational cost, together with changes in SenseScore, message alignment, and persuasion across iterations.
Questions for authors
- Could the evaluation include aesthetic quality and text legibility alongside its existing consistency and message-alignment criteria?
- Text is already acknowledged in the paper, but its contribution to sensory evocation remains unclear. Separating textual and nontextual contributions would strengthen the analysis.
- Why are Qwen-Image results included in Table 3 but omitted from Figure 6?
- Could SenseScore support reward-based optimization of image generators? This is an interesting future direction, provided message alignment and visual quality are also considered.
2 comments
[Q1-Q2]Aesthetic quality, text legibility, and textual contributions.
Thanks for the suggestions. We clarify that our work is the first to study sensory advertisement generation, focusing on two objectives: (1) conveying the intended advertisement message and (2) evoking a target sensation. While aesthetics, text legibility, and disentangling textual from nontextual contributions are interesting directions, they are beyond the scope of this work. We hope our task, dataset, and evaluation metric will encourage future research on these aspects, including the contributions of individual advertisement components to sensory evocation. We will clarify this scope and discuss these directions as future work.
[Q3] Qwen-Image in Fig. 6.
Thanks, we will include a full set including both Qwen-Image images and ablation results in appendix.
[Q4] SenseScore for reward-based optimization.
Thanks for the interesting suggestion. SenseScore could potentially serve as a reward signal for optimizing image generators toward stronger sensation evocation. However, as shown in Fig. 7, improving sensation intensity alone does not necessarily improve message alignment or persuasion. This suggests that reward-based generation should jointly optimize sensation evocation, message alignment, and visual quality, rather than maximizing SenseScore alone. We will discuss this potential direction in the revised paper.
We thank Reviewer f5kJ for their constructive feedback. We are glad they found our study to provide valuable perspective, our dataset to provide detailed annotations and our evidence on evaluation metric useful. We address each concern and question inline.
We first clarify that SenseScore is not used in SAGA's generation loop; it is an independent metric for evaluating sensation evocation. Instead, SAGA uses an MLLM-based evaluator to provide feedback on visual consistency, message alignment, and sensation evocation (Sec. 3.3, L293–301; Appendix F).
To further evaluate SAGA's design choices, we conducted additional ablations on 270 images, using the same FLUX generator, FluxKontext editor, and refinement stopping criteria (Sec. 3.3, L293–301; Fig. 4). Removing evaluator priority increases SenseScore (0.85 → 0.93) but decreases AIM (0.69 → 0.67), showing that stronger sensation evocation can come at the expense of message alignment. Removing the text refiner also decreases both metrics. Here is the table including the the ablations and the strongest baselines.
We further clarify that our primary contribution is introducing the sensory advertisement generation task, dataset, and evaluation metric, rather than proposing a fundamentally novel agentic method. SAGA provides a task-specific iterative refinement baseline, and these ablations support the benefit of its design choices in balancing sensation evocation and message communication. We will include the results in the revised paper (Table X, highlighted in blue).
Thanks for the suggestion. We clarify that our evaluation already includes DALLE3, which automatically rewrites and expands prompts before generation, providing a strong prompting baseline beyond direct generation with the original template. SAGA achieves higher SenseScore (0.83 vs. 0.79) and significantly higher AIM (0.66 vs. 0.63, p < 1e-5) than DALLE3 (Table 3). Further, our new additional ablation (W1) use the same FLUX generator, FluxKontext editor, and refinement stopping criteria, showing that removing evaluator priority in critic agent, the text refiner, or critic agent reduces AIM (0.69 → 0.67). These results support the benefit of SAGA's task-specific refinement beyond stronger initial prompting and generic agentic pieline. We further clarify we see SAGA as a strong baseline for the newly introduced SenseGen task, rather than an optimal or state-of-the-art agentic generation method. We hope that this work inspire future works to develop stronger and more efficient methods.
We clarify that the stopping criteria are already described in Sec. 3.3 (L293–301) and Fig. 4: SAGA terminates when the Evaluator returns "No Issue" or the maximum conversation budget is reached. We will additionally report the average number of refinement iterations 3, maximum number of messages 20 and the average number of messages 11 per image (revised the paper in C4 (L937-941) and L302), and provide a qualitative example illustrating how evaluator feedback guides successive image refinements.