- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper aims to address the "creative paradox". If a model produces an interesting answer and training reinforces that answer, similar answers become more likely. That helps reproduce a past success, but creativity requires continuing to produce different ideas. The authors propose learning reusable ways of generating creative answers, through primers.
Critical strengths
-
The research of creativity is an important subject, this paper addresses an interesting paradox. Generating novel samples once is not enough, they should continue be surprising over time.
-
Separating the trainable priming model from the frozen response model is a useful design choice in my opinion. The experiments in table 3 show that the learned guidance generalizes beyond the response model used during training, allowing the same priming model to be reused without retraining each responder.
Critical weaknesses
-
An answer can remain different from the fixed reference set even after the system has generated it many times. The diversity metrics capture variation within the evaluated response set, but do not track novelty against an accumulating output history. Although the authors acknowledge this limitation and propose addressing it in future work, the experiments leave open whether Creative Priming can sustain novelty over time. This limits the evidence supporting the claim that the method escapes the “creative paradox.”
-
Two papers that might be useful to discuss are - [1] and [2] (below). Importantly, the authors should discuss and distinguish their approach from the one presented in [2].
[1] Creative Preference Optimization, Ismayilzada et al. (EMNLP 2025 Findings) [2] Guiding Large Language Models via Directional Stimulus Prompting. Li et al. (NeurIPS 2023)
Questions for authors
-
Did the authors try to use an evolving set of references?
-
Can the authors provide a more isolated experiment to distinguish between the contribution of the creative priming and the gain from the model separation?
-
It seems to me that for the comparisons of the creative priming with other methods, the authors standardized advantages for all methods, whereas the original DARLING removes standard-deviation normalization. Can the authors please clarify this or provide a fair comparison using the DARLING original setup ?
-
Can the authors clarify what shows that learning primers avoids reinforcing recurring answer patterns, given that rewarding a primer can also make the ideas it induces more likely? Have you checked whether the diversity reward reflects variation among high-quality, novel answers, or is partly driven by low-quality outliers?
2 comments
Response to authors
Thank you for the detailed rebuttal (I appreciate the easy-to-follow, transparent and short responses.)
The revisions to the paper are informative, they have clarified my concerns.
Regarding question 2 - I meant (2) and missed it in the appendix. This answers my question.
I maintain my positive scoring.
Thank you for the thoughtful questions and for the new references! We believe that your input can help to improve the paper, and we appreciate your efforts in this regard.
Strengths: We're glad that you found the creative paradox to be interesting, and fully agree that sustained creativity over time is an important direction to investigate. We hope that this work can inspire many more researchers to creatively explore the idea of creativity in AI.
Weaknesses:
Questions for authors: