- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
EvoMol introduces a framework that continuously refines the reasoning strategies of LLMs by transforming failures in molecular reasoning into explicit, reusable rules, without updating model parameters. The authors represent the model’s reasoning context as a structured “logic kernel” containing task decomposition strategies, chemical constraints, and output verification rules, which is progressively refined through iterative evolution. EvoMol follows a reasoning–diagnosis–evolution–consensus selection pipeline. The paper refers to information gathered during task execution, such as observed errors and the associated chemical or reasoning principles, as “semantic gradients,” which provide directional feedback for prompt refinement. The framework also introduces a Reflective Proposer and uses a Multi-Frontier Pareto Consensus mechanism to iteratively generate and select the next generation of reasoning contexts. Experiments mainly demonstrate performance improvements on the Qwen2.5-3B, Qwen2.5-7B, and Qwen2.5-14B models.
Critical strengths
EvoMol transforms lessons learned from failures into inspectable, reusable reasoning rules and provides experimental evidence supporting their effectiveness. Its main contribution lies in consolidating failure feedback into explicit reasoning strategies.
Critical weaknesses
-
The lack of comparisons with directly relevant prompt optimization methods leaves the method’s incremental value insufficiently established. Although the paper discusses feedback-driven methods such as GEPA[1] in the related work section, its main experiments compare EvoMol only with zero-shot direct prompting and GRPO, without direct comparisons against other prompt optimization methods. The reported results only show that EvoMol outperforms the static prompts used in the experiments and the particular GRPO configuration under a specific low-resource setting. They do not sufficiently establish the method’s superiority more broadly. In addition, the paper does not provide separate ablation studies to isolate the contributions of the structured semantic gradients and the Multi-Frontier Pareto Consensus mechanism.
-
Lack of novelty. The core framework overlaps substantially with GEPA, and the idea of accumulating chemical reasoning experience as reusable knowledge is not new, as it has already been explored in ChemAgent[2]. Again, the paper should at least include a direct comparison with GEPA.
[1] Agrawal, L. A., Tan, S., Soylu, D., et al. (2026). GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning. In Proceedings of the 14th International Conference on Learning Representations (ICLR 2026). [2] Tang, X., Hu, T., Ye, M., et al. (2025). ChemAgent: Self-updating Memories in Large Language Models Improves Chemical Reasoning. In Proceedings of the 13th International Conference on Learning Representations (ICLR 2025).
Questions for authors
Suggestions for future work:
Need additional experiments: under the same chemical tools, knowledge base, reflection model, and evaluation budget, does the proposed structured feedback significantly outperform simply providing raw error information to GEPA?