- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces AI Night-Scientist, an RL-trained agent for scientific ideation. The agent jointly selects actions and semantic creativity levels during multi-step reasoning, allowing it to vary how broadly it searches, which perspectives it considers, and how strongly it challenges existing assumptions. The authors use GRPO to optimize proposal quality and evaluate the framework on tasks derived from NSF awards. The experiments assess predicted citation impact, literature-grounded originality, and research-idea diversity, with comparisons against temperature control, ReAct, and several RL variants.
Critical strengths
The framework offers a useful and interpretable way to control exploration during scientific ideation. Selecting an action together with its creativity level makes the exploration strategy explicit. Learning when to use different degrees of exploration is an interesting contribution, particularly for open-ended tasks where consistently conservative or highly exploratory behavior may be ineffective.
The internal comparisons provide reasonable evidence for the proposed design. The temperature, ReAct, restricted-action, and reward ablations help distinguish the effects of the main components. Under the paper’s evaluation protocol, the results suggest that semantic creativity guidance provides benefits beyond increased sampling randomness. Considering both proposal quality and diversity also makes the study informative.
Critical weaknesses
My main concern is that the related-work discussion could more clearly establish the incremental contribution relative to existing RL-based scientific ideation methods. Relevant approaches include LDC, Learning to Generate Research Idea with Dynamic Control (2024); MoRI, Learning Motivation-Grounded Reasoning for Scientific Ideation in Large Language Models (2026); and EvoIdeator, Evolving Scientific Ideas through Checklist-Grounded Reinforcement Learning (2026). These works address dynamic generation control, motivation-grounded reasoning, and feedback-driven iterative refinement, respectively. Discussing them would help explain what is added by jointly learning action selection, action-specific creativity levels, and their scheduling.
The paper already acknowledges AI Can Learn Scientific Taste and uses its Scientific Judge. However, a more specific discussion of the Scientific Thinker generation model from that work would strengthen the comparison. The authors could explain how their process-control framework differs from directly optimizing generated ideas through comparison-based GRPO.
I consider these concerns addressable through a stronger literature discussion and clearer contribution boundaries. I do not consider substantial new baseline experiments necessary for acceptance.
Questions for authors
What capability does learning action-specific creativity levels add relative to dynamic control in LDC, reasoning optimization in MoRI, and iterative refinement in EvoIdeator? A concise comparison of their control mechanisms and training objectives would be helpful.
How do the reported paradigm and contribution-type diversity metrics relate to fluency, flexibility, and within-task ideation diversity in prior work? Please clarify the scope of the conclusions supported by the current metrics.
3 comments
Thanks for your clarification
Thanks for your detailed clarification! I will maintain my rating.
Thank you; Summary of Paper Modifications Based on Your Feedback
Thank you for your acknowledgement! We have added the additional requested literature review and contribution discussion into the updated manuscript (L132-140), as well as additional diversity metric clarifications (Section 4.2) and qualitative analysis (Section 4.4.2 & Table 4) based on your feedback! We hope that this has adequately addressed any further concerns you have for acceptance.
Clarifying Our Novel Methodological Contributions Relative to Existing Work & Diversity Evaluation
We thank the reviewer for their thoughtful assessment. We appreciate their recognition of (i) the interpretability of our creativity-aligned framework, (ii) the value of learning when and how to explore during scientific ideation, and (iii) the evidence from our temperature, ReAct, and reward ablations that semantic creativity guidance provides benefits beyond sampling randomness. We are also encouraged that the reviewer considers the remaining concerns addressable through clearer positioning with related works.
We re-iterate our primary novel methodological contributions:
In general, while these prior approaches learn to improve scientific ideas, they differ in where creativity is represented, what actions are available, and what the model learns to control. We summarize this below:
Overall, we emphasize the need for both structure and a lack thereof in creative research ideation (which is a novel perspective from existing work), learning when to explore unconventional directions versus develop promising ones. With these differences clarified, we hope that it is clear that we take a significant departure from existing work on scientific creativity.
We will expand Sec. 2 to better acknowledge these complementary approaches and clarify these contribution boundaries.
Rather than introducing new diversity metrics/categories, we adopt and adapt existing research taxonomies to evaluate two complementary aspects of scientific ideation:
For both, we measure corpus-level categorical diversity using the normalized effective number of categories, exp(H)/K, where H is Shannon entropy and K=7 (Sec. 4.2; Appendix H).
These metrics are related to flexibility, as they capture breadth across conceptual categories, but differ from fluency (number of distinct ideas generated per problem) and within-task diversity (variation among multiple ideas for the same problem). Our evaluation instead measures the breadth and balance of proposal types across the test set.
As shown in Sec. 4.4.2 (Table 3b), AI Night-Scientist increases research-paradigm diversity by 27.8% and contribution-type diversity by 14.9% over Qwen3-8B. These results support broader exploration of different kinds of research ideas across problems, without implying improved within-task diversity or fluency.
We will clarify these distinctions in Sec. 4.2 and explicitly qualify the scope of our diversity claims. Thank you!