- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper applies Bayesian optimization to zero-shot NAS using a VAE-learned architecture space. It represents architecture blocks as prefix sequences and combines zero-shot proxies into a single search score. The selected model reaches 81.51% top-1 accuracy on ImageNet-1K and is also evaluated on COCO and ADE20K.
Critical strengths
1、The problem is worth studying, and the proposed representation offers a practical way to search a complex architecture space with Bayesian optimization. 2、The paper reports results on ImageNet-1K and two downstream datasets rather than relying only on small NAS benchmarks.
Critical weaknesses
1、The paper mainly brings together existing ideas. It is not clear what is genuinely new compared with earlier work on latent-space NAS and Bayesian optimization. 2、The results do not show that Bayesian optimization is the reason for the improvement. There is no fair comparison with random or evolutionary search under the same budget, and the 0.36-point gain over UniNAS-A is reported without repeated runs. 3、The presentation is weak. Figure 1 is the only method figure and explains little beyond the general workflow. Table 3 extends beyond the normal text width, and equation references are inconsistent, using “Eq.”, “equation”, and “Equation”. 4、Key review materials are missing. The manuscript cites Appendix Table 5, Section A.4, Equation (12), and Appendix Figure 2, but none appears in the supplied file. The GitHub link also does not provide accessible code at review time.
Questions for authors
1、State what is new compared with existing latent-space NAS and Bayesian optimization methods, and explain why the difference matters. 2、Compare Bayesian optimization with random and evolutionary search under the same budget. Report results from repeated runs to support the claimed improvement. 3、Improve Figure 1 so that it shows the actual method, fix the width of Table 3, and use a consistent style for equation references. 4、Provide the missing appendix content, including Table 5, Section A.4, Equation (12), and Figure 2. Supply a working anonymous code repository that reviewers can access.