- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes RevoNAS, a neural network search architecture based on large language models, designed to address redundancy in the generation of LLM-based architecture search methods. The proposed method consists of three components, namely Multi-round Multi-expert Consensus, Adaptive Reflective Design Exploration, and Pareto-guided Evolutionary Selection. Experiments on NAS-Bench-201 and other benchmarks show that RevoNAS achieves promising results.
Critical strengths
-
This article addresses a key issue in the NAS based on LLM, particularly the challenges of generating redundant architectures, invalid designs, and low exploration efficiency under a limited computational budget.
-
This article is well-written and very well-organized.
-
On the NAS-BENCH201 benchmark, the proposed method achieved highly competitive results with a very small number of architecture queries.
Critical weaknesses
- The novelty of the proposed framework is very limited. The three components proposed by the author have already received a considerable amount of research [1-4]. It seems that the author merely combined them.
[1] Yang Z, Zeng W, Jin S, et al. Nader: Neural architecture design via multi-agent collaboration[C]//2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2025: 4452-4461.
[2] Ji Z, Zhu G, Yuan C, et al. RZ-NAS: Enhancing LLM-guided Neural Architecture Search via Reflective Zero-Cost Strategy[C]//ICML. 2025.
[3] Chen A, Dohan D, So D. Evoprompting: Language models for code-level neural architecture search[J]. Advances in neural information processing systems, 2023, 36: 7787-7817.
[4] Lu Z, Whalen I, Boddeti V, et al. Nsga-net: neural architecture search using multi-objective genetic algorithm[C]//Proceedings of the genetic and evolutionary computation conference. 2019: 419-427.
-
The ablation experiment lacks a control group for Multi-expert Multi-round Consensus, making it difficult to determine the role of this component.
-
The author claims that only a very small number of architecture queries are needed to achieve competitive results. I would like to ask whether, with such a small number of architecture evaluations (for example, 5 in NASBENCH-201), adaptive adjustment of exploration and exploitation is possible.
Questions for authors
See Weaknesses above.