- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a post-training framework that enables diffusion models to generate more creative images. The core idea is to encourage candidate images to deviate from reference images by defining a novelty reward based on their average perceptual distance from a reference set. This training strategy facilitates self-reinforcement without requiring a separately trained reward model to evaluate creativity. Experiments on MNIST and T2I generation demonstrate that encouraging deviations from conventional data distributions can lead to more novel and creative outputs.
Critical strengths
-
The proposed method is intuitively well motivated. Creativity often involves departing from conventional data distributions while remaining within a meaningful and coherent range. However, a similar principle has also been adopted by ConceptLab. The main distinction is that this work applies the idea directly to the post-training of diffusion models.
-
Although training a diffusion model may initially appear computationally expensive, the proposed post-training procedure is a one-time investment. Once completed, it avoids the repeated optimization cost required for each creative generation task, as in methods such as ConceptLab.
-
I particularly appreciate the experiments on MNIST. Despite their simplicity, they provide an intuitive and compelling illustration of the core idea. This is a notable strength compared with prior methods that are evaluated exclusively on T2I generation.
Critical weaknesses
-
During training, the proposed method uses CLIPScore and PickScore as reward signals, thus training procedure is not fully self-supervised. Since none of the baseline methods appear to use these additional supervision signals, I am uncertain whether the improvements in VQAScore reported in Table 2 reflect a fair comparison. I would also appreciate clarification on why VQAScore is considered an appropriate metric for evaluating image creativity. '0.002, N/A' in Table 2 appears to be a typo.
-
Although Table 2 reports computational costs, the cost reported for the proposed method appears to include only online inference, while omitting the offline cost of post-training the diffusion model. I expect this offline training cost to account for a substantial proportion of the total computational expense. It would therefore be helpful to report the complete training cost and provide a break-even analysis: how many batches of images must be generated before the one-time training cost is offset by the reduction in per-generation overhead? For example, if a user wishes to generate creative images for only a single concept, conducting large-scale post-training may be less flexible or cost-effective than an optimization-based method such as ConceptLab.
-
To the best of my understanding, the proposed method relies on relatively detailed prompt templates to guide creative generation, whereas many related methods use substantially more generic prompts, such as 'a creative {subject}'. If such detailed prompts are already required, it is unclear why users could not simply describe the desired creative concept directly in natural language. In my preliminary experiments with Stable Diffusion 3.5 and FLUX, natural-language descriptions alone were sufficient to produce images that departed substantially from conventional representations and exhibited forms of creativity similar to those shown in the paper. GPT-5.6 produced even stronger results. This raises questions about how much of the observed improvement should be attributed to the proposed post-training method rather than to prompt engineering or the capabilities of the underlying model. I am also curious about the method's sensitivity to the prompt template at test time. How does performance change when a different template is used?
-
Regarding the qualitative evaluation, why are only 20 object categories considered, and what criteria were used to select them? In my view, this number is too small to support robust conclusions about the method's qualitative performance. Moreover, the paper does not present any failure cases, making it difficult to assess the method’s limitations and generalization ability. For example, after post-training, can the model generate creative images across arbitrary domains, such as 'a creative cat' or 'a creative car'? The range of domains demonstrated in the paper remains limited, making it difficult to determine whether the benefits of the proposed method justify its training cost.
Questions for authors
See Weaknesses
We thank the reviewer for highlighting the intuitive motivation, the value of amortizing post-training across future generations, and the MNIST experiments as a clear illustration of the central idea.
Training signals and metrics - CLIPScore and PickScore are used only during the initial guidance-distillation stage. The resulting SD3.5 checkpoint serves as both the initialization for creativity training and a matched baseline, so this comparison isolates the effect of our model-derived creativity objective. VQAScore measures category validity rather than creativity; novelty is measured by KID. We also confirm that “0.002, N/A” in Table 1 is a typo and should read “0.002 | N/A.”
Efficiency - Table 1 reports online generation and per-concept adaptation costs but omits our one-time post-training cost. Our intended setting is a reusable model serving many prompts and samples, over which this cost is amortized. For a single concept, a training-free or per-concept method may be faster.
Prompting - Our method and the matched SD3.5 baseline share the same underlying pretrained model and prompt template, ensuring that the observed performance differences cannot be attributed to differences in the base model's capabilities or prompt formulation. Figure 9 also uses the same neutral prompt and seed, without creativity-inducing words, and our model still produces the less conventional interpretation. Detailed instructions specifying what should vary require the user to anticipate the novel outcome in advance. Our method allows the generation of surprising interpretations that the user would not think to request.
Evaluation - The 20 categories were selected randomly, and no evaluation prompt appeared in the fine-tuning set. This exceeds the four categories used by VLM-Guided and five used by C3 in their quantitative evaluations. Because we fine-tune a shared generator rather than optimize a concept-specific representation, the same model remains applicable to free-form prompts, including categories such as cats or cars.