- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SPAL-Net, a semantic prior-guided framework for semi-supervised oriented object detection. It introduces a Semantic Alignment Module to enhance multi-scale visual features using CLIP text embeddings, an Instance-Level Distribution Alignment Loss to incorporate inter-class semantic relationships, and Class-Adaptive Pseudo-Label Filtering to improve unlabeled supervision. Experiments on DOTA-v1.0 and DOTA-v1.5 demonstrate competitive performance across different annotation budgets.
Critical strengths
-
The paper explores the integration of vision-language semantic priors into semi-supervised oriented object detection, providing a potentially useful direction for reducing annotation dependence.
-
The proposed framework incorporates textual priors into both multi-scale feature learning and instance-level supervision, enabling semantic information to influence different stages of detection.
-
The method achieves strong performance on DOTA-v1.0 and DOTA-v1.5 across multiple annotation budgets, with consistent improvements over the underlying teacher-student baseline.
Critical weaknesses
-
The paper explores the integration of vision-language semantic priors into semi-supervised oriented object detection, providing a potentially useful direction for reducing annotation dependence.
-
The proposed framework incorporates textual priors into both multi-scale feature learning and instance-level supervision, enabling semantic information to influence different stages of detection.
Questions for authors
-
The methodological novelty is relatively limited, as the framework mainly combines CLIP-based feature enhancement, semantic distribution alignment, and class-adaptive pseudo-label filtering within an established Mean Teacher architecture. The paper does not sufficiently distinguish its contributions from existing vision-language distillation and adaptive pseudo-labeling methods.
-
IDAL assumes that semantic similarities between CLIP class-name embeddings provide appropriate supervision for visual instance discrimination. However, linguistic similarity does not necessarily correspond to visual similarity in aerial imagery, and the paper provides no evidence that the resulting class relationships reflect actual visual confusion patterns.
-
The effectiveness of CAPF in improving pseudo-label reliability is insufficiently demonstrated. Its thresholds are derived from the mean confidence of predictions that already pass a global threshold, but higher confidence does not necessarily indicate higher pseudo-label precision. The experiments do not directly evaluate pseudo-label precision, recall, or class-wise selection quality against fixed-threshold alternatives.
-
The ablation studies do not adequately establish whether the improvements originate from meaningful textual semantics rather than additional model capacity or generic regularization. Comparisons using randomized class embeddings, shuffled semantic relationships, or conventional label smoothing are necessary to validate the claimed benefits of semantic prior-guided learning.
4 comments
Response to Reviewer 2iyH [Part 2/3]
Question 3:
Whether CAPF improves pseudo-label precision, recall, and class-wise filtering quality
Response:
We thank the reviewer for the suggestions on pseudo-label reliability and its evaluation. Higher confidence does not necessarily imply higher pseudo-label precision. We have therefore added comparisons of pseudo-label quality across filtering strategies and a class-wise analysis to Appendix B of the revised manuscript (Tables 8 and 9). Under the 10% labeled-data setting on DOTA-v1.5, SAM and IDAL are disabled, and teacher models trained with different filtering strategies are evaluated under a common protocol. Table 8 shows that CAPF achieves higher precision and mAP than fixed global and fixed class-specific thresholding, but has lower recall, illustrating the precision–recall trade-off.
Table 8. Pseudo-label quality and detection performance of models trained with different filtering strategies.
| Filtering Strategy | Precision (%) | Recall (%) | mAP (%) |
|---|---|---|---|
| Fixed Global Threshold | 69.36 | 51.16 | 45.09 |
| Fixed Class-Specific Thresholds | 74.33 | 50.26 | 47.23 |
| CAPF (Ours) | 80.52 | 48.69 | 48.78 |
Table 9 reports selected class-wise results for precision, recall, and the number of retained predictions. CAPF improves precision in 13 of the 16 classes and improves both coverage and precision for Helicopter. However, precision decreases for Soccer ball field and Roundabout, and Container crane still receives no effective coverage, showing that the gains are not uniform across classes.
Table 9. Class-wise pseudo-label quality and retained counts (selected classes).
| Class | Recall (%) Global / CAPF | Precision (%) Global / CAPF | Retained Global / CAPF |
|---|---|---|---|
| Plane | 84.41 / 74.18 | 77.51 / 91.11 | 4,877 / 3,646 |
| Bridge | 42.77 / 40.86 | 17.34 / 38.42 | 1,944 / 838 |
| Small vehicle | 41.55 / 40.12 | 71.42 / 80.77 | 42,750 / 36,498 |
| Helicopter | 0.00 / 35.94 | 0.00 / 82.14 | 1 / 56 |
| Soccer ball field | 29.63 / 47.33 | 46.45 / 26.50 | 155 / 434 |
| Roundabout | 66.20 / 69.34 | 42.89 / 29.31 | 443 / 679 |
| Container crane | 0.00 / 0.00 | 0.00 / 0.00 | 6 / 42 |
Response to Reviewer 2iyH [Part 3/3]
Question 4:
Whether the gains from textual semantic priors arise from meaningful semantics rather than additional model capacity or generic regularization
Response:
We thank the reviewer for the valuable suggestions on validating the effectiveness of semantic priors and strengthening the ablation design. Experiments that replace class embeddings and supervision targets support additional benefits from CLIP class representations and their induced relationships. These experiments separately evaluate the contribution of class representations to the overall framework and the contribution of IDAL’s auxiliary supervision targets.
(1) Comparison of different class embeddings.
To determine whether the gains arise from additional model capacity, we compare fixed random, learnable random, and CLIP text embeddings using the same network architecture and training setup under the 10% labeled-data setting on DOTA-v1.5. SAM and IDAL share the corresponding embeddings, while CAPF remains enabled. Table 4 shows that CLIP text embeddings outperform both random alternatives, supporting the contribution of pretrained class representations to the overall framework. The experiment has been added to Section 4.2 of the revised manuscript.
Table 4. Ablation of Class Embeddings.
| Embedding Type | mAP (%) |
|---|---|
| Fixed Random Embeddings | 49.61 |
| Learnable Random Embeddings | 52.26 |
| CLIP Text Embeddings (Ours) | 54.77 |
(2) Comparison of IDAL with conventional label smoothing.
To distinguish IDAL’s gains from those of generic regularization, we compare standard label smoothing, an IDAL variant that retains the auxiliary alignment structure but uses uniform targets, and full IDAL (Table 5) under the 10% labeled-data setting on DOTA-v1.5, with SAM and CAPF disabled. The first method is applied to the RoI classifier, including background samples; the latter two use the same auxiliary structure and differ only in their supervision targets. Full IDAL outperforms both controls, supporting the contributions of the auxiliary alignment structure and the non-uniform semantic targets. This experiment has been added to Section 4.2 of the revised manuscript; module complementarity is discussed in Question 1 above (Table 3).
Table 5. IDAL vs. Label Smoothing.
| Method | mAP (%) |
|---|---|
| Baseline | 45.09 |
| Standard Label Smoothing | 45.64 |
| IDAL (Uniform Label Smoothing) | 48.67 |
| IDAL (Ours) | 51.24 |
Thank you again for your review. We hope our response could address your concerns. If you have any further questions, we would be happy to discuss them further.
Response to Reviewer 2iyH: Clarification on Ethics Concerns
Response:
We noticed that "Flag For Ethics Review" was marked as "Yes". However, we could not identify any specific ethical concerns in the review comments. The concerns raised primarily relate to methodological novelty, semantic supervision, pseudo-label reliability, and experimental validation, which we have carefully addressed in our rebuttal.
We take research ethics seriously and are committed to adhering to the ICLR Code of Ethics and responsible research practices. To the best of our knowledge, we are not aware of any ethical issues associated with our submission.
We would sincerely appreciate it if the reviewer could clarify any specific ethical concerns regarding our work, so that we can address them appropriately.
Thank you again for your time and consideration.
Response to Reviewer 2iyH [Part 1/3]
We thank you for your insightful and constructive feedback. Our responses follow.
Question 1:
Response:
SPAL-Net's central innovation is the cross-stage use of class-level semantic priors: it enhances multi-scale representations before region proposal generation, models class relationships at the RoI level, and links class-adaptive pseudo-label selection to semantic supervision on unlabeled data.
(1) SAM. Unlike vision–language distillation constraints applied to region-level representations, SAM introduces class-level semantic priors into feature learning before region proposal generation, allowing them to inform both region proposals and subsequent RoI representations. Specifically, SAM constructs spatially structured semantic context from dense class responses and modulates multi-scale features before proposal generation, enabling class priors to contribute to proposal generation and instance-level learning.
(2) IDAL. The key difference between IDAL and uniform label smoothing lies in the class relationships encoded by their supervision targets. IDAL uses textual semantic relationships to construct class-dependent auxiliary targets, retaining standard classification supervision while adding class relationships not explicitly represented by one-hot labels. This complements SAM’s feature-level semantic priors with instance-level relational supervision.
(3) CAPF. CAPF shares the motivation of adaptive-threshold methods but differs in the source and update of its threshold statistics. FlexMatch [1] adjusts thresholds according to class learning progress, FreeMatch [2] adaptively adjusts global and class-specific thresholds, and Li et al. [3] jointly consider classification and localization quality. Specifically, CAPF uses detection confidences that pass a fixed global threshold to dynamically update class-specific filtering criteria, balancing a global confidence floor with differences in confidence across classes. In SPAL-Net, the retained pseudo-labels also supervise unlabeled detection and assign class-relationship targets for IDAL.
We have added “Adaptive Pseudo-Label Selection in Semi-Supervised Learning” to Related Work to compare CAPF with prior thresholding methods. Tables 3–5 in Section 4.2 evaluate module combinations, class embeddings, and supervision targets; the latter two comparisons are detailed in Question 4 below.
Question 2:
Response:
We thank the reviewer for raising this question about the rationale for IDAL’s semantic supervision. We do not assume that semantic similarity between CLIP class-name embeddings fully corresponds to visual similarity or class-confusion patterns in remote-sensing images. IDAL uses textual semantic relationships as an auxiliary class prior and applies a KL-divergence constraint to the visual class distribution of positive RoIs. The standard detection classification loss based on ground-truth or pseudo-labels remains responsible for learning visually discriminative features.
To analyze the correspondence between textual semantic relationships and visual confusion, we have added a quantitative analysis and visualization to Appendix E of the revised manuscript (Figure 4). Specifically, we use a baseline teacher model without SAM or IDAL and construct a class-agnostic confusion matrix on DOTA-v1.5 under the 10% labeled-data setting, using matching at rotated IoU ≥ 0.5. Across 120 class pairs, CLIP text similarity has a moderate positive correlation (Spearman ρ = 0.468, permutation-test p = 0.0001) with the bidirectional average visual confusion rate. At confidence thresholds of 0.3 and 0.6, the corresponding correlation coefficients are 0.440 and 0.443, respectively. These results indicate that textual semantic relationships are associated with visual confusion to some extent, but do not fully characterize class confusion in remote-sensing images, particularly its directionality.
In addition, Table 5 in Section 4.2 of the revised manuscript compares the uniform IDAL target with the CLIP-semantic target. With SAM and CAPF disabled under the same setting, the CLIP-semantic target achieves 51.24% mAP, compared with 48.67% for the uniform target, an improvement of 2.57 percentage points. This indicates that non-uniform class relationships provide additional benefit to IDAL.
[1] Bowen Zhang et al. FlexMatch: Boosting Semi-Supervised Learning with Curriculum Pseudo Labeling. NeurIPS, 2021.
[2] Yidong Wang et al. FreeMatch: Self-Adaptive Thresholding for Semi-Supervised Learning. ICLR, 2023.
[3] Hengduo Li, Zuxuan Wu, Abhinav Shrivastava, and Larry S. Davis. Rethinking Pseudo Labels for Semi-Supervised Object Detection. AAAI, 2022.