- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The approach in the paper aims to preserve diversity in reward-guided text-to-image generation. It does so by selecting initial latents for neighborhood robustness and semantic coverage. The authors reports experiments with SDXL and SD3.5, noting improved diversity with competitive quality.
Critical strengths
I think the paper makes a useful and interesting point, which is that diverse initial noise samples do not necessarily lead to semantically diverse outputs. Additionally, during reward-guided refinement, diversity can actually diminish. The idea to treating initialization as a separate stage is thus interesting and a plausible way to address this issue. To me, the two proposed stages are also intuitive. And the paper actually does show that each stage contributes something.
Overall, an interesting and well written paper.
Critical weaknesses
While the approach in the paper is interesting, there are a few weaknesses that would need to be addressed before acceptance.
For example, the paper calls the measure “average pairwise DINOv2 similarity"; however, higher values are treated as better. Since higher similarity usually means less diversity, the paper should define the metric and its direction. This makes the main results thus a bit difficult to interpret for me.
For me, to reproduce it, the feature mapping used for semantic coverage would need to specified in more detail, e.g. identify parts such as the encoder, layer, and preprocessing, and clarify how it relates to the DINOv2 evaluation metric, etc.
Finally, the paper should clarify what neighborhood robustness and semantic coverage add to guidance-potential initialization. It also seems like the current ablation does not establish gains over the closest prior approach.
Minor points:
- I found two spelling errors: "denoising trajectorie” and “Further analysis are provided”
- Space missing between a few approaches and their citations, e.g. "DivGen(Parmar et al., 2026)", "pretrained distribution(Gao et al., 2023; Uehara et al., 2024)" etc.
Questions for authors
-
What exactly is the reported DINOv2 diversity metric? pairwise similarity, distance, or a transformed score such as one minus similarity?
-
What encoder, layer, and preprocessing define the feature mapping in the semantic coverage objective?
-
Could you provide variability estimates across the three runs (tables 1 and 2, etc.)?
-
Novelty appears somewhat incremental, i.e.the method combines local robustness with semantic-coverage selection. This is not necessarily bad but it would be great if the authors could further highlight what is the most unique contribution of the approach.
3 comments
Thank you for the clarifications, which addressed most of my original concerns. I would still appreciate variability estimates for Table 2 but otherwise I'm happy to increase my score.
Thank You for Your Helpful Feedback and Response
Thank you for your willingness to increase your score. We also appreciate your suggestion regarding the variability estimates in Table 2. Given the limited time remaining in the rebuttal period, we will conduct the corresponding experiments and include the variability estimates in the revised version of the paper. We wish you all the best!
We sincerely thank the reviewer for the careful review and thoughtful attention to the experimental details and practical aspects of our work, and we are more than happy to provide further clarifications and additional evidence to address these concerns.
Response to Weaknesses 1
We thank the reviewer for pointing out this inconsistency. This is indeed a typographical error in the description of the metric. Our intention was to evaluate generation diversity using the average pairwise DINOv2 distance, rather than similarity. Specifically, the pairwise distance is defined as \begin{equation} b_{ij}=1-\cos\left(f_{\mathrm{DINO}}(x^{(i)}),f_{\mathrm{DINO}}(x^{(j)})\right) \end{equation} where fDINO(⋅) denotes the DINOv2 feature representation. A higher value therefore indicates greater dissimilarity between generated samples and, consequently, higher diversity. The reported results were computed using this distance metric. We apologize for the misleading description and will correct the text in the revised manuscript.
=========================================================================
Response to Weaknesses 2
We instantiate the feature mapping P(⋅) using a frozen DINOv2 ViT-B/14 encoder with publicly available pretrained weights. Specifically, we extract the normalized CLS token from the final Transformer layer as the global image representation. Input images are converted to RGB, resized to 224×224 using bicubic interpolation, and normalized using the ImageNet mean and standard deviation. The extracted features are then L2-normalized before constructing the semantic coverage matrix.
=========================================================================
Response to Weaknesses 3
Given the time and computational constraints during the rebuttal period, we conducted three additional independent runs for the experiments in Table 1 and report the results in the form of mean ± standard deviation (Mean ± Std) to provide a better assessment of the variability across different random seeds.
SDXL
SD3.5
=========================================================================
Response to Weaknesses 4
Our key contribution is to introduce a new perspective on diversity preservation by shifting its focus from auxiliary objectives during reward optimization to the design of the initial candidate population. Specifically, we aim to construct a population whose diversity is both efficient to establish and robust to subsequent reward-driven updates. To this end, we introduce a local robustness objective to identify candidates in broad low-potential regions, together with a population-level semantic coverage objective to reduce redundancy and preserve complementary semantic modes among the selected candidates.