- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors present an agentic framework, SAGE, for designing electrolytes that meet prescribed requirements. They use simulations in the form of molecular dynamics (MD) and density functional theory (DFT) to evaluate performance. New candidates are proposed based on the performance history, using a system of five subagents with different roles. The agents are all pretrained, but have access to different tools and are controlled by different prompts.
Critical strengths
S1: Strong performance
The success rate widely surpasses that of other agentic frameworks, both general-purpose and materials science-specific ones. An ablation study shows that each proposed novelty significantly improves performance.
S2: Clear presentation
The motivation is clear, and each component is presented in a logical fashion.
Critical weaknesses
W1: Overstates the applicability and generalizability
You consistently portray SAGE as being "physics-based" and do not sufficiently state its limitations. Your "physical experiments" are just simulations and would be more accurately described as such; swapping "physics-based" for "simulation-based" would be a good first step. MD and DFT are computationally costly simulations that are certainly informative of electrolyte performance, but at the same time can only probe limited time and spatial scales. Important aspects such as slow reactions, SEI growth, aging, and other degradation phenomena are beyond reach and would require actual physical experiments to test.
W2: Specific insights missing, reproducibility questionable
For something to be a valuable scientific contribution, others must be able to build on top of it.
The proposed agentic framework is highly complex, with many moving parts and intricacies, and it's not clear how it differs from standard harnesses like Claude Code or Codex. Describing all of it in sufficient detail for someone to reproduce would require an excruciatingly detailed paper. As far as I can tell, the only practical way for someone to build on the full framework is if you would open-source the code. Barring that, how is anyone supposed to trust and independently verify that your superior performance actually holds up under scrutiny? (Table 7 provides an ablation, but I get suspicious when all components provide 25-50% improvements in success rate. Similarly, the improvements in Table 2 seem too good to be true. )
An alternative route would be to isolate and pin down specific mechanisms that are transferable to other settings. Frankly, without proper evidence to back it up, describing the role of each subagent is just storytelling. Take, for instance, the claim that "The reflector routes each actionable failure to the part of the system best suited to address it" (l. 310). This sounds like it would be possible to test, but it currently isn't.
W3: Missing comparisons to non-agentic approaches
In the experiments, baselines only include other agentic frameworks. I think it would be very important to include non-agentic baselines, e.g., Bayesian optimization and even classical Design of Experiments (without feedback). These are probably not applicable in all settings, but please include comparisons where they are applicable. Curiously, in the appendix, the composer is described as using a task-specific objective vector to rank candidates that combines with a genetic algorithm to generate new candidates, so it does seem like you've given some thought to using more classical methods.
Minor: You talk about "gates" long before they are defined.
Questions for authors
Q1: What is specific to electrolytes in their "self-improving agentic search problem"? Why isn't it just an arbitrary black-box optimizer?
Q2: How does SAGE balance exploration vs. exploitation? Why is an agentic approach presumed to be more efficient than established methods such as reinforcement learning, genetic algorithms, or Bayesian optimization? From the looks of it, the setting seems like one where reinforcement learning with verifiable rewards (RLVR) would be applicable, is there a reason for not taking such an approach?
Q3: Why not model all components with nonnegative concentrations, thereby side-stepping the issue of discrete variables?
Q4: How do you deal with the fact that many constraints are not known a priori? See, e.g., Hickman et al. "Anubis: Bayesian optimization with unknown feasibility constraints for scientific experimentation." Digital Discovery 4.8 (2025): 2104-2122.
5 comments
Part 2
W3: Missing comparisons to non-agentic approaches.
We thank the reviewers for this thoughtful point.
- We adapt and add eight non-agentic methods: Gaussian Process Bayesian Optimization, static Design of Experiments, NSGA-II, Proximal Policy Optimization (PPO), ExtraTrees active learning, Tree-structured Parzen Estimator (TPE), Thompson sampling, and the Cross-Entropy Method. All methods use the same component pool, admissibility checks, physical evaluation protocol, acceptance thresholds, initialization, and candidate budget, differing only in how subsequent candidates are selected.
- Classical methods underperform SAGE because they do not explicitly learn and distill physical failure experience into actionable guidance for subsequent search, which is critical in a complex, jointly constrained space.
- We consider this broader comparison important and have included the results in the revised manuscript, as reported in Table 3 (page 10).
| Method | General | Fast Charge | Low Temp | High Temp | High Voltage |
|---|---|---|---|---|---|
| GP Bayesian Optimization | 19 | 18 | 12 | 15 | 4 |
| Static DoE | 13 | 8 | 5 | 5 | 0 |
| NSGA-II | 22 | 20 | 11 | 14 | 3 |
| PPO | 17 | 12 | 7 | 9 | 4 |
| ExtraTrees Active Learning | 20 | 17 | 9 | 12 | 2 |
| TPE | 19 | 15 | 7 | 9 | 2 |
| Thompson Sampling | 17 | 13 | 6 | 8 | 1 |
| Cross-Entropy Method | 21 | 19 | 10 | 11 | 3 |
Minor.
This is an important point. A gate is a pass/fail criterion for whether a candidate formulation satisfies a predefined property constraint. We have revised the manuscript accordingly on page 3, with changes marked in red.
Q1: Specific design for electrolytes & interpretability.
This is an insightful point.
- Electrolyte design involves a hybrid discrete-continuous space in which salt, solvent, and additive identities and their concentrations jointly determine coupled properties such as transport, viscosity, solvation, aggregation, and oxidation tendency. Thus, SAGE learns from electrolyte-specific MD/DFT failure signals and updates design policies over chemically meaningful components, interactions, and operators.
- Rather than treating failure as a scalar reward, SAGE identifies the violated constraint and its formulation context. Failures such as excessive ion aggregation, poor transport, unstable coordination, or unfavorable cluster VIP are then converted into targeted evidence retrieval, hypotheses, and candidate refinement actions.
- SAGE is not an arbitrary black-box optimizer: it preserves a complete optimization trail from observed failure and supporting evidence to an actionable policy update and subsequent formulation change, while deterministic programs retain numerical authority and fixed physical simulations determine outcomes.
- Therefore, the resulting artifacts capture meaningful electrolyte design experience rather than black-box objective values, allowing the learned search strategies to be inspected, reused, and adapted across different design regimes in a human-interpretable way.
Q2: Exploration vs. exploitation & efficiency of SAGE & RLVR.
We appreciate these valuable concerns.
- SAGE balances exploration and exploitation through explicit budget allocation: early iterations emphasize broad coverage, while later iterations exploit validated parents and repair informative near-misses through bounded mutation, substitution, and recombination. Final candidates are selected from a larger pool to balance exploitation, failure repair, evidence support, and compositional diversity.
- We empirically study exploration-first selection (Table 4, page 10) to assess this trade-off and find that it improves coverage and works particularly well on the high-temperature task, but is less effective on the others, highlighting a task-dependent balance between diversity-driven exploration and targeted exploitation.
- We do not assume that an agentic approach is inherently efficient. Our added comparisons with classical methods (Table 3, page 10) test this empirically under the same physical budget. SAGE performs better because it improves itself through failure-to-policy learning without any model training and human intervention, whereas the established methods considered mainly rely on numerical rewards or feasibility outcomes.
- This is a very good point. RLVR is possible in principle, but this setting offers only limited, costly physical simulations, with sparse rewards and delayed MD/DFT feedback under coupled constraints. SAGE instead uses training-free policy refinement, treating individual constraint violations and counterexamples as structured feedback without requiring large-scale policy training or a hand-designed scalar reward. We also included an RL-based approach (PPO) as a baseline in Table 3 (page 10).
Part 3
Q3: Alternative design of components.
We apprecaite this thoughtful question.
- Assigning every possible component a nonnegative concentration does not remove the underlying discreteness: component presence changes molecular identity, chemical compatibility, and charge balance, while finite-size MD requires integer molecule counts and cannot faithfully represent arbitrarily small concentrations.
- Besides, it would instead create a high-dimensional and sparse search space, where many near-zero formulations map to the same realizable molecular composition, reducing both optimization efficiency and interpretability.
Q4: Unknown Priori.
This is a critical concern.
- SAGE does not require the feasibility boundary to be known a priori: when MD/DFT evaluation reveals an unanticipated failure, SAGE diagnoses the physical cause and converts the evidence into a context-specific policy update that guides subsequent proposals away from similar failures while retaining exploration in unknown regions.
- In practical electrolyte design, the overall acceptance criteria are predefined [1], but which formulations satisfy them under different conditions is learned through MD/DFT evaluation. Methods such as Anubis are complementary for modeling unknown constraints, whereas SAGE focuses on actionable failure diagnosis and reusable artifacts rather than an explicit probabilistic feasibility model.
[1] Meng, Y. Shirley, Venkat Srinivasan, and Kang Xu. "Designing better electrolytes." Science, 2022.
Part 1
We sincerely thank the reviewer for the careful assessment and constructive suggestions. Below, we address each concern point by point:
W1: Overstates the applicability and generalizability.
We appreciate this important point.
W2: Specific insights missing, reproducibility questionable.
This is a very valuable suggestion.
Detailed ablations
Policy guidance machanism
Failure-routing mechanism