- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposed object detection on edge devices, and requires satisfying simultaneous constraints on energy, latency, and memory. This paper introduces a framework that combines the "XiResOFA" search space (featuring an elastic structure), a two-stage energy estimator, and a multi-objective iterative search process to derive an accuracy-energy Pareto frontier. The resulting achieves accuracy comparable to YOLOv12 on the PascalVOC and COCO datasets, while reducing GPU/NPU energy consumption by up to 53.7%/51.6%.
Critical strengths
A strength of this paper is its reliance on direct energy measurements taken from actual hardware. They measures real-world power consumption on an Adreno 650 GPU, a 15 TOPS NPU, and a Jetson Orin Nano (over 1,000 times trial).
This enhances the credibility of the findings. the XiResOFA search space is well-designed: it consistently applies the same family of blocks across the backbone, FPN, and PAN components. By avoiding disparate search rules for different modules, the framework facilitates natural weight sharing among subnets; the entire search space is governed by a unified design philosophy.
Critical weaknesses
It has a limitation that the search space is restricted to architectures derived from YOLOv12 (XiResOFA uses YOLOv12n as its base), the search results inherit the inductive biases of this specific family.
The authors report that the search space itself is concentrated in a region that, on average, consumes 21.1% less energy than the original YOLOv12; this raises a question that requires further analysis: is the efficiency discovered through the search truly a result of the search process itself, or is it merely a consequence of the biases embedded in the design of the search space?
Questions for authors
- Does the post-search scaling process affect other metrics, such as energy consumption or accuracy?
- It is difficult to verify whether accuracy is being effectively captured by the proxy; is there any additional supporting evidence for this?
- The paper appears to focus on multi-device applicability—is there any evidence to support this claim?
Response to Reviewer 5924
We thank Reviewer 5924 for the helpful feedback. We first address the questions on post-search scaling, accuracy-proxy reliability, and multi-device applicability, then isolate the contribution of the search process from the XiResOFA search space.
1. Does Post-Search Scaling Affect Accuracy and Energy? (Q1)
Yes. Scaling improves trained accuracy while increasing physical inference energy. We trained five representative architectures across nano, small, and medium scales (15 configurations) on PascalVOC under a matched 300-epoch protocol with early stopping:
2. Does the Accuracy Proxy Preserve Useful Architecture Rankings? (Q2)
Yes, for ranking against inherited-supernet accuracy. NAS primarily requires reliable relative ordering to filter promising candidates rather than exact prediction of final standalone mAP. Below we reproduce the held-out validation from Section 4.4, Table 1 (200 held-out architectures per dataset):
The rank correlations (ρ=0.75–0.89) measure ordering consistency, while Recall@10% (0.40–0.60) measures recovery of top-performing candidates. These results support proxy-guided candidate selection rather than exact final-accuracy prediction. The 15 independently trained scaled models in Q1 provide complementary downstream validation confirming strong trained accuracy across scales, though they are not a separate 200-architecture fully trained rank test.
3. What Evidence Supports Multi-Device Applicability? (Q3)
The generic energy prior generalizes zero-shot to unseen hardware, while optimal architectures remain device-dependent. We measured 214 matched architectures across Adreno 650 GPU, Adreno NPU, Jetson AGX Orin, and Jetson Orin Nano. To test prediction transfer explicitly, we performed leave-one-device-out (LODO) evaluation on 98 common architectures, excluding all target-device data during generic-prior training. On 78 held-out architectures per target, zero-shot results are:
The 0.811–0.896 rank correlations and 0.23–1.37% selection regret show that our energy predictor transfers well to unseen hardware without target-device calibration. However, directly transferring architectures selected on Adreno GPU to other devices incurs 4.81–7.32% net-energy regret on COCO under matched accuracy constraints (and 8.1–23.0% top-10% gross-energy regret across all 214 architectures; see Response KB9F). This motivates our two-stage design combining a transferable prior with sparse target calibration (note: full sparse-calibrated NAS in the paper was conducted on Adreno GPU, while the other devices evaluate cross-device transfer).
4. Is the Gain Due to Search or the XiResOFA Search Space? (W1)
Both contribute, and the search gain remains large after controlling for the search space. While Figure 8(a) shows that XiResOFA itself favors low-energy architectures, we compared our iterative NAS with random search inside that identical XiResOFA space across 15 matched seeds and 20,000 evaluations:
Because both searches share the exact same YOLOv12-derived architectural biases, the +21.1% / +27.3% Pareto HV improvement isolates the additional benefit of guided NAS beyond the efficiency of XiResOFA. We will incorporate all new analyses into the revised manuscript.