- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper presents OptiGen, an agentic framework for deep-ultraviolet laser diode design that combines simulation-based retrieval, physics knowledge retrieval, multi-objective optimization, and LLM-based reasoning. The framework is evaluated on 100 benchmark queries using four language models. The results demonstrate its potential for assisting device design, although further validation is needed to establish its effectiveness and the advantages of its agentic architecture.
Critical strengths
- The paper addresses a practical problem in DUV-LD design by integrating simulation-based retrieval, physics knowledge retrieval, multi-objective ranking, and LLM-based reasoning into a unified framework.
- The evaluation covers multiple design tasks and four language models, providing an initial assessment of the framework's performance across different settings.
Critical weaknesses
- The framework mainly follows a fixed workflow. The paper does not clearly explain how the agents work together or why this design is better than a simpler pipeline.
- Removing the simulation retrieval module improves several key metrics, including the hallucination-free rate and end-to-end success rate. This raises questions about whether the module is needed.
- The benchmark is limited, and the paper does not clearly explain how the ground truth is built. The expert evaluation includes only five queries, which is not enough to show that the system is reliable in real design tasks.
- The paper tests only four language models, some of which are relatively old. Testing newer models could help show whether the framework remains useful with stronger models.
Questions for authors
- The framework seems to follow a fixed workflow. Can the authors explain what the agentic design adds compared with a simple pipeline?
- Why does the performance improve when the simulation retriever is removed? It would be helpful if the authors could explain why this module is needed.
- How are the ground-truth results for the test queries obtained? Could the authors also test more recent and advanced models, such as Claude Opus, and include more expert evaluations to better validate the system?
We sincerely thank the reviewer for the constructive feedback and for recognizing the practical relevance of OptiGen to DUV laser diode design. We have carefully considered the concerns and made additional clarifications and experimental revisions to strengthen the methodological explanation and evaluation of the framework.
1. Agentic architecture and advantages over a conventional pipeline
OptiGen is designed as a domain-specific, LLM-orchestrated framework for AlGaN deep-ultraviolet laser diode (DUV-LD) design. Its objective is to improve the precision and scientific reliability of design recommendations by grounding LLM reasoning in simulation data and domain-specific scientific knowledge.
The framework integrates two complementary knowledge sources: a SiLENSe-generated simulation database containing DUV-LD structures targeting 267 nm emission, and a physics knowledge base covering the materials, structural properties, and operating mechanisms of AlGaN-based DUV-LDs. Simulation retrieval identifies relevant device configurations and performance characteristics, while physics retrieval provides the scientific principles needed to interpret them. The parsed query determines the execution of task-specific components, including design ranking for optimization queries. Supplementary web retrieval is conditionally activated when simulation results do not satisfy the specified requirements or the available physics context is insufficient.
We clarify that OptiGen is not intended to provide unrestricted autonomous planning. Rather, it coordinates specialized components through a domain-specific workflow. Its contribution lies in integrating simulation-grounded evidence, physics-informed retrieval, task-dependent ranking, and conditional knowledge acquisition. We have also expanded the comparative evaluation by reporting expert and LLM-as-a-judge assessments against standalone general-purpose models, including ChatGPT and Claude.
2. Simulation Retriever ablation results
We acknowledge the reviewer’s observation that removing the Simulation Retriever improves certain metrics, particularly the hallucination-free rate and end-to-end success rate. This suggests that the current implementation may introduce redundant or less relevant simulation-derived context, especially because the downstream Ranker independently accesses the same simulation dataset.
Although both components use the same dataset, they serve distinct purposes. The Simulation Retriever identifies relevant simulated structures and their performance characteristics to support evidence-based reasoning and explanations. In contrast, the Ranker selects candidates through Pareto filtering and weighted ranking based on optical output power, threshold current, and optical confinement factor.
The observed improvement after removing the retriever may therefore result from overlapping information that does not always benefit response generation. Nevertheless, the retriever provides supporting simulation evidence, particularly for queries requiring the identification and interpretation of relevant structures. We have clarified these distinct roles and added a discussion of the observed ablation results and potential information redundancy to the limitations section.
3. Ground-truth construction, advanced LLM evaluation, and expert assessment
The benchmark ground truth was established through manual verification using the SiLENSe simulation dataset as the primary reference, together with domain knowledge of AlGaN-based DUV-LDs. We examined the simulated structures and their corresponding optical output power, threshold current, and optical confinement factor. Reference structures and rankings were verified according to each query’s optimization objectives and constraints, ensuring that expected results were grounded in simulation evidence and relevant physical principles rather than solely in LLM-generated responses.
To evaluate a more recent reasoning model, we incorporated Claude Opus 5.5 by replacing the underlying LLM within the existing OptiGen framework while keeping the architecture, retrieval pipeline, benchmark queries, and evaluation protocol unchanged. This provides a controlled comparison of different reasoning backbones within the same framework.
Additionally, we conducted a separate comparative evaluation of OptiGen against standalone general-purpose models including ChatGPT and Claude, on 10 queries. We have incorporated the corresponding results in the revised manuscript.