- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes LayerFi-FSOD for few-shot remote sensing object detection. It analyzes the different characteristics of DINOv3 features across layers and introduces two modules, ADPIM and DSGM, to transfer spatial and semantic knowledge to a student detector. DINOv3 is only used during training and removed at inference.
Critical strengths
- The motivation is clear, and the layer-wise analysis provides useful insights into the design, from which I learned a lot.
- The method achieves strong results on DIOR and NWPU VHR-10, especially in low-shot settings.
- The ablation studies are fairly comprehensive, and removing DINOv3 at inference is a practical advantage.
Critical weaknesses
- Although DINOv3 is removed at inference, it is still required during training. The training time and GPU memory overhead would be useful to report.
- The performance appears sensitive to the choice of DINOv3 layers in Table 5. It would be helpful to further examine whether the selected layers generalize well across different datasets.
- The roles of ADPIM and DSGM at inference are not entirely clear. Since both modules are designed around DINOv3 features, it would be helpful to clarify how their learned knowledge is actually retained by the student after DINOv3 is removed.
Questions for authors
Please refer to the concerns raised in the Weaknesses. In particular, addressing Points 2 and 3 would be important for improving my overall assessment.
3 comments
Response (2/2) to Review EQ3n, we remain open to further discussion.
-
Weaknesses: The roles of ADPIM and DSGM at inference are not entirely clear. Since both modules are designed around DINOv3 features, it would be helpful to clarify how their learned knowledge is actually retained by the student after DINOv3 is removed.
Response: We thank the reviewer for this suggestion. We clarify the roles of ADPIM and DSGM and how the student retains their knowledge after DINOv3 is removed.
- ADPIM and DSGM are both excluded from inference. ADPIM constructs DINOv3 visual priors only during fine-tuning and enhances student RoI features through gated residual fusion. During inference, this fusion branch is removed, and the detector directly uses RoI features extracted from its own FPN for classification and regression. DSGM provides distillation supervision only during training, while its teacher feature extraction, relation computation, and auxiliary distillation branches are all excluded from inference. Therefore, the final detector retains only the optimized ResNet-101, FPN, and detection heads, without any DINOv3-dependent feature extraction or fusion modules.
- Visual priors are retained in the student network parameters through gradient-based optimization during training. The residual fusion in ADPIM not only enhances detection supervision using DINOv3 [1] features but also preserves the gradient propagation path through the original student RoI features, allowing the detection loss to update the student network. More importantly, DSGM does not merely constrain the fused detection outputs: LSSD directly supervises the spatial self-similarity distribution of the student's own RoI features, while GSAD constrains the inter-proposal semantic relationships of the student's classification representations. Since the teacher relation targets are stop-gradient, the distillation errors are backpropagated through the student branches, encouraging their parameters to learn the corresponding spatial structures and semantic relationships. Thus, knowledge transfer occurs through parameter optimization during training rather than relying on teacher features at inference.
Nevertheless, introducing ADPIM during training may still cause the student to depend on external features. To examine whether this potential training–inference discrepancy affects detection performance, we compare the inference results with and without DINOv3 on NWPU VHR-10 (novel-class mAP50, %):
| Method | 3-shot | 5-shot | 10-shot | 20-shot |
|---|---|---|---|---|
| LayerFi-FSOD w. DINOv3 | 63.01 | 67.16 | 72.88 | 86.33 |
| LayerFi-FSOD w/o DINOv3 | 63.46 | 67.94 | 73.32 | 86.06 |
After removing DINOv3, performance improves by 0.45/0.78/0.44 percentage points under the 3/5/10-shot settings, respectively, while decreasing by only 0.27 percentage points under the 20-shot setting. These results indicate that removing the training-time visual prior branches does not cause a noticeable performance degradation, and the student can independently perform detection using its own learned representations. Together with the gradient-based optimization mechanism described above, these results support that the training guidance provided by ADPIM and DSGM can be transferred into the student's independent detection capability without requiring continued access to DINOv3 during inference.
[1] Simeoni, Oriane, et al. "DINOv3." TMLR, 2026.
-
Questions: Please refer to the concerns raised in the Weaknesses. In particular, addressing Points 2 and 3 would be important for improving my overall assessment.
Response: We thank the reviewer for further emphasizing the importance of Points 2 and 3. To address these concerns, we provide additional experimental validation and further clarify the relevant mechanisms:
- Regarding the sensitivity of layer selection and its cross-dataset generalization (see Weakness 2): The sensitivity mainly arises from the alignment between features at different depths and the learning objectives of ADPIM and DSGM, while also being influenced by dataset characteristics, including object scale distributions, category composition, and scene complexity. We further conduct additional experiments on DIOR Split 2. Consistent with NWPU VHR-10, the selected layer configuration achieves the best performance on both datasets, validating its cross-dataset generalization capability.
- Regarding the knowledge retention mechanism after removing DINOv3 (see Weakness 3): We further clarify the training and inference procedures of ADPIM and DSGM and explain how visual priors are transferred into the student network parameters through gradient-based optimization. Furthermore, the inference comparison with and without DINOv3 shows that removing DINOv3 does not cause noticeable performance degradation, confirming that the student detector can perform detection independently.
Response to Authors
Thank you for your detailed response and explanation. However, taking into account the discussions with the other reviewers as well as our previous correspondence, I am inclined to maintain my original score.
Response (1/2) to Review EQ3n, we remain open to further discussion.
We greatly appreciate the reviewer’s insightful comments and provide our detailed response below. We also welcome any further questions or suggestions.
Response: We thank the reviewer for this important suggestion. We agree that although DINOv3 is removed during inference, its training overhead should still be explicitly quantified. We compare the fine-tuning time and peak GPU memory usage of LayerFi-FSOD and SAE-FSDet [1] on NWPU VHR-10 under the same experimental conditions:
Compared with SAE-FSDet, LayerFi-FSOD requires 3.32–4.20× the fine-tuning time and 3.43–3.57× the peak GPU memory, mainly due to visual prior learning with frozen DINOv3. Importantly, this overhead occurs only during offline few-shot fine-tuning, while yielding novel-class mAP50 gains of 5.50/8.54/2.30/0.98 percentage points at 3/5/10/20-shot, respectively. DINOv3 and all auxiliary branches are completely removed at inference, and the student retains the same inference architecture as SAE-FSDet without additional overhead. The teacher-free detector requires 181.13 GFLOPs and achieves 28.06 FPS. Thus, our method represents an explicit trade-off between training cost and inference efficiency: additional offline computation improves detection under limited annotations without increasing deployment costs.
[1] Liu, Yanxing, et al. "Few-Shot Object Detection in Remote-Sensing Images via Label-Consistent Classifier and Gradual Regression." TGRS, 2024.
Response: We thank the reviewer for this important suggestion. We agree that it is necessary to explain the sensitivity to layer selection and validate the selected configuration across datasets. This sensitivity mainly arises from the alignment between features at different depths and the learning objectives of ADPIM and DSGM, while also being influenced by dataset characteristics. According to our layer-wise analysis, shallow-to-middle-layer features exhibit stronger inter-patch spatial variation, facilitating the construction of dense spatial priors in ADPIM, whereas middle-to-deep-layer features show stronger foreground responses, benefiting the modeling of inter-object semantic relationships in GSDM. Therefore, introducing too many deep-layer features into ADPIM may weaken spatial details, while using only the final layer or indiscriminately fusing multiple layers may fail to fully exploit the complementary advantages of representations at different depths. Furthermore, differences in object scale distributions, category composition, and scene complexity across datasets may affect the contribution of visual priors from different layers, leading to varying degrees of sensitivity to layer selection.
To further validate the cross-dataset generalization of this hierarchical division, we conduct additional layer selection experiments on DIOR Split 2 and compare the results with NWPU VHR-10 (novel-class mAP50, %):
The results show that although the magnitude of performance variations differs across datasets, assigning shallow-to-middle-layer features to ADPIM and middle-to-deep-layer features to GSDM achieves the best performance among the evaluated configurations on both datasets. As complementary evidence of dataset-dependent variability, the three-seed results reported in our response to Reviewer AsPM (Weakness 3) show generally larger standard deviations on NWPU VHR-10 than on DIOR, indicating greater sensitivity to few-shot sample selection. These findings indicate that while the degree of sensitivity to layer selection may be influenced by dataset characteristics, the selected hierarchical allocation consistently performs best across the two evaluated datasets, supporting the importance of aligning features from different depths with the learning objectives of the corresponding modules.