Limited methodological novelty and missing comparisons with closely related work. The proposed framework primarily combines established active learning concepts, including uncertainty-based sampling, diversity-based selection, class balancing, and adaptive sample weighting. More importantly, instance-level active learning and predicted-error-based selection have already been explored in prior work:
Yoo and Kweon, Learning Loss for Active Learning (CVPR 2019), introduced a learned loss-prediction module for selecting informative unlabeled samples.
Lyu et al., Box-Level Active Detection (CVPR 2023), introduced ComPAS, which selects individual objects for annotation and combines human labels with pseudo-labels.
Box-Level Class-Balanced Sampling for Active Object Detection (ICIP 2024) already explored class balancing in box-level active learning.
The related work and experimental comparisons do not sufficiently establish how Active-SAOOD fundamentally advances beyond these approaches. In particular, the claim that existing active learning methods primarily operate at the image level overlooks relevant box-level frameworks. Comparisons against image-level methods alone are insufficient to establish the novelty of instance-level selection.
Potential mathematical weakness in the proposed MSO sampling mechanism. Equation (11) defines the final sampling score as:
S_final = A_bar * S + (1 - A_bar) * (1 - S).
This can be rewritten as:
S_final = (1 - A_bar) + (2 * A_bar - 1) * S.
Consequently, when A_bar = 0.5, every instance receives the same final score, regardless of its uncertainty or diversity. When A_bar is below 0.5, the ranking favors lower values of S, while above 0.5 the ranking reverses. Thus, the formulation produces a ranking reversal at a fixed threshold rather than a genuinely smooth transition from easy to difficult samples.
This observation challenges the claimed continuous adaptation to the model's learning state. The authors should provide additional theoretical justification and demonstrate that the proposed formulation is preferable to simpler or smoother curriculum-based alternatives.
Insufficient validation of instance uncertainty estimation under extremely sparse supervision. The localization and orientation uncertainty prediction (LUP) module is trained to estimate regression errors using the limited labeled instances. However, the paper does not directly demonstrate how accurately these predicted uncertainties correspond to actual localization and orientation errors on previously unseen instances.
This is important because the central motivation is to improve annotation selection when supervision is extremely limited. A poorly calibrated uncertainty estimator could select uninformative instances, while confidently incorrect predictions and entirely missed objects may never be selected.
Although the ablations demonstrate the usefulness of the combined localization-orientation criterion, they do not establish the reliability of the uncertainty predictions themselves. Additional analysis of prediction-error correlation, uncertainty calibration, and candidate proposal recall would substantially strengthen the claims.
A secondary experimental concern is that the 1% results in Table 1 coincide with the maximum values reported across five runs in Table 4, rather than the corresponding means. The authors should clarify the reporting protocol and provide mean and standard deviation results consistently across all annotation budgets.
Q1: Ablation study on detection uncertainty and representation diversity
Thank you for your suggestions. We have conducted additional ablation experiments on detection uncertainty and representation diversity. As shown in the table, removing either detection uncertainty or representation diversity leads to a substantial performance drop. Combining both achieves the best performance of 35.79% mAP. These results demonstrate that the detection ability and representation generalization are complementary, and jointly considering both leads to better performance.
Q2: Experiment on alternative weighting strategy
We compare alternative weighting strategies, as shown in the table. Linear and nonlinear weighting achieve close performance. In fact, Eq. (11) is simply a straightforward choice, as other formulations that avoid introducing too many difficult-to-learn instances when the model is weak could also satisfy this requirement.
More importantly, the key component of Eq. (11) is the ability-aware instance value S, defined in Eq. (10), which dynamically weights instance values according to model's current abilities across dimensions, thereby selecting instances that better improve the model's abilities in the corresponding dimensions. This enables instance valuation to consider not only instance information but also model's abilities and learning needs. To further verify this, we replace ability-aware instance value in Eq. (10) with a direct summation of active learning metrics (common practice, i.e., ∑Ui). This results in a substantial performance drop of 2.97%, demonstrating the importance of ability-aware instance value.
Q3: Effect of candidate quality on detection performance
Thank you for your suggestion. We use three models with different performance to generate candidate instances of varying quality and further evaluate the quality of these candidates. We then apply our Active-SAOOD to select the same number of instances from each candidate pool to ensure a fair comparison. The selected instances are combined with the initial 1% labeled data to train the S2Teacher, and the final mAP is reported. As shown in the table, higher candidate quality leads to greater performance gains from active learning. However, the differences in gains across different candidate quality levels are relatively small, and even low-quality candidates can bring significant improvements. This suggests that when the model's ability is limited, selecting relatively valuable instances can already yield substantial performance gains. As the model becomes stronger, it can generate higher-quality candidates, enabling active learning to select more valuable instances and further improve the overall performance. Thus, candidate quality and the model ability can mutually reinforce each other.