- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors proposed a three-stage pipeline for coil optimization, in which an LLM outputs a semantic command that is translated into a 4-dimensional search subspace, and traditional BO is then used for numerical optimization. I like the idea of bridging the LLM and BO with a search direction (subspace) that leverages the strengths of both, and of mimicking the traditional human-in-the-loop design process by incorporating expert knowledge. My concern then is how general this methodology is, since the GGT is highly manually configured and embedded with domain knowledge. The methodology is also quite close to other publications (e.g., LGBO, ICLR 2026), so a clearer comparison should be provided.
Critical strengths
- The idea of using LLM and BO for semantic decision and numerical execution, respectively.
- Clear and fair baseline and ablation setup.
Critical weaknesses
- The proposed GGT is too specific to the coil case, whereas the paper claims to present a general methodology. There is a lack of clarity about how much the pipeline relies on the proposed GGT (related to Q1), making it hard to distinguish the contributions of the LLM and the representation.
- Lack of recent similar works in baselines (e.g., LGBO, LMABO, etc., both in ICLR 2026)
Questions for authors
- How much the pipeline relies on the proposed GGT. Especially as reported in Table 2, GGT design will greatly affect the final outcome (both in loss and unif.). What I read from this is that the gain in semGMS is due to a good subspace setup strategy rather than to introducing LLM semantic guidance. What is your comment on this?
- Suppose we admit the GGT to be a routine. Is there any non-LLM way to determine the searching manifold (e.g., an online surrogate to predict h = (o,kappa,eta,beta) with expectation improvement that can be naturally integrated into the BO framework)? How is this compared to an LLM planner?
- What is the difference between SEMGMS and the recent baselines? This helps to coordinate the contribution.
3 comments
I thank the authors for their additional experiments that addressed some of my concerns. I appreciate the matched planner and direction comparison results, which explicitly split the contribution of the LLM planner and LLM-provided evidence, and the baseline test that includes more methods.
However, I still find the results too specific to the coil case. The authors didn’t make much methodological contribution to the machine learning community. They demonstrated that LLMs can assist in optimization with semantic guidance, and that this works in a specific engineering area. Nevertheless, I don’t think a GGT that defines a manifold is common in most complex engineering problems, so applying the proposed methods to other use cases would be difficult. I therefore believe it would fit better in a journal than in ICLR and consequently keep my score (=2).
In addition, a minor concern is that all experiments here are with only one seed. My experience in similar tasks is that optimization is quite sensitive to the seed due to multimodality, so a multi-seed test would be recommended.
Response to Reviewer 1vJJ (2/2)
Thank you for your feedback on the additional experiments. We appreciate your questions about the methodological contribution, its applicability beyond coils, and sensitivity to random seeds.
- 1. Why this problem matters. Spatial-coil design is a common electromagnetic inverse-design problem in applications such as induction heating and magnetic-field generation. It exemplifies a broader challenge in AI for Science: optimizing high-dimensional designs with a limited budget of expensive black-box simulations and no access to simulator gradients. A small change to one part of a coil can affect the response at several targets, and each candidate is expensive to evaluate. Full-coordinate search must explore many coupled variables under a tight simulation budget, and a fixed parametric design can omit the local changes needed to improve a weak response. SemGMS (our method) uses simulation feedback to identify where and how to edit the coil, translates that edit into a small set of coordinated deformations, and uses Bayesian optimization to determine how much to move. This lets the search adapt its parameterization to the physical response observed in each round.
- 2. Methodological contribution and scope. The contribution is to use semantic guidance to construct the numerical search space itself. LGBO uses LLM guidance to adjust the surrogate mean, and LMABO uses it to select the acquisition function. SemGMS instead grounds a semantic action into a low-dimensional family of candidate designs. Proposition 1 (§4.4) gives a conditional local descent result for this construction. If the selected family contains a useful descent direction and enough feasible room to move, the objective improves when the available decrease exceeds the executor’s finite-budget search error. The same approach could apply wherever meaningful edits can be described semantically and translated into feasible changes to design parameters. A new domain would require its own translation rules. Our task covers three spatial-coil design scenarios with distinct objectives and target geometries.
- 3. Multi-seed evidence. The main evaluation compares SemGMS with seven baselines over five random seeds on each of the three tasks (§§5.1–5.2, Table 1). Each seed uses a different initial coil, shared by all methods within that seed, and each run has a budget of 200 simulator evaluations. SemGMS achieved the lowest mean uniformity errors across all three tasks. For example, its WLO uniformity error averaged 3.96% with a standard deviation of 0.29 percentage points, and it achieved the lowest welding-loss uniformity error on HFLO in all five runs. Appendix E.1 provides the multi-seed analysis, and Appendix E.3 (Table 11) reports the five-seed WLO comparison with Full-Space GP and Parametric BO. Thank you again for your careful reading and thoughtful questions. We appreciate the opportunity to discuss these points further.
Response to Reviewer 1vJJ (1/2)
Thank you for your thoughtful comments and questions. We respond to each of your comments below.
A1.
Table R1. Matched planner and direction comparison on WLO.
A2.
Table R2. WLO comparison with recent LLM-guided BO baselines.
We hope our responses address your questions and concerns. We would be happy to discuss any of these points further with you.