- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a multi-agent (specifically, 4-agent) system to solve the update requests to power grids.
It proposes new benchmarks and the proposed method shows consistent improvement compared to other LLM-based methods.
Critical strengths
- The overall writing is good and clear
- The model design is reasonable
- It proposes new task benchmarks on existing grid networks.
Critical weaknesses
- Looks like there exists related benchmark: “ProOPF: Benchmarking and Improving LLMs for Professional-Grade Power Systems Optimization Modeling”; maybe more experiments shall be conducted on the existing benchmarks. Right now this paper proposes new benchmark and show performance gain only on the proposed benchmark is not fully convincing.
- All the baselines are LLM-based. I m not super familiar with related works in this domain but there shall include non-LLM-based methods. Comparison with them would be important.
- Overall in my view, the proposed method is a domain-specific way to combo the existing LLMs with appropriate prompt engineering works. That level of novelty is at most on the borderline for a top-tier ML conference.
Questions for authors
Please check the weaknesses mentioned above.