- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Target Saliency Boosting, a task that aims to increase the visual saliency of a specified object during text-to-image generation without requiring explicit saliency maps. The authors propose GazeME, which uses learnable focus and unfocus marker embeddings to control the relative saliency of objects. To train these embeddings, the paper constructs an automatically annotated dataset using SAM3 and AAM to obtain object-level saliency scores, and introduces Saliency Prior Marker Activation (SPMA) to generate saliency-aware marked prompts. The pretrained generative model is frozen, and only four marker embeddings are optimized using the standard flow matching objective. Experiments on FLUX.1-dev and Stable Diffusion 2.1 report improvements in target saliency over several baselines.
Critical strengths
- The idea of jointly enhancing target objects and suppressing non-target objects is reasonable.
- The proposed method is lightweight as optimizing only four marker embeddings while keeping the generative model frozen.
- The experimental evaluation is relatively comprehensive.
Critical weaknesses
- Previous works such as DreamArtist[1] and Prompt Sliders[2] have already explored using learnable text embeddings for positive and negative control of image generation. GazeME follows a similar approach by learning focus and unfocus embeddings while keeping the generative model frozen. The main difference is that GazeME uses AAM scores to assign these markers and introduces SPMA during training. It is unclear how much these additional designs improve upon existing embedding-based control methods.
- AAM is used both to label the training data and to calculate the main evaluation metric, Target-NSS. Although an additional evaluation with TranSalNet and a user study are provided, the user study only includes 17 prompt–target object pairs and only compares GazeME with FLUX-Editing.
- In Table 2, the w/o SPMA setting only activates the marker of the most salient object. This also removes the training of unfocus markers, so it is ambiguous whether the improvement comes from SPMA or simply from using both focus and unfocus markers.
[1] Dong, Z., Wei, P. and Lin, L., 2025. DreamArtist: Controllable One-Shot Text-to-Image Generation via Positive-Negative Adapter: Z. Dong et al. International Journal of Computer Vision, 133(10), pp.7037-7053.
[2] Sridhar, D. and Vasconcelos, N., 2024, September. Prompt sliders for fine-grained control, editing and erasing of concepts in diffusion models. In European Conference on Computer Vision (pp. 17-31). Cham: Springer Nature Switzerland.
Questions for authors
- Section 3.2 states that only four marker embeddings are optimized, while it's unclear how these tokens are initialized and incorporated into the architecture.
- Equations (3) and (4) rely on the nearest higher or lower saliency score, but the paper does not explain how to handle cases where multiple objects have the same saliency score.
- How much of the Target-NSS improvement comes from increasing the target object's saliency, and how much comes from suppressing the saliency of other objects?