- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces UAVOVD, a visible–infrared open-vocabulary oriented object detection benchmark for low-altitude scenarios, and LAOVD, a multimodal open-vocabulary oriented object detection framework. A Structure-Guided Asymmetric Gated Fusion (SGAGF) module is designed to fuse infrared and visible modalities. LAOVD achieves superior performance on several benchmarks.
Critical strengths
- The paper introduces the first visible–infrared OVD benchmark for low-altitude scenarios, with more object categories than previous datasets.
- The paper is well written and easy to read.
Critical weaknesses
- The motivation and necessity for dual-modality open-vocabulary object detection are not explored in sufficient depth. The modality fusion design is not inherently connected to open-vocabulary object detection. The architectural innovations do not stem from the specific difficulties and challenges of open-vocabulary object detection. Instead, the paper reads more like a combination of modality fusion, open-vocabulary object detection, and a new dataset. It does not sufficiently explain why multimodal fusion is necessary for open-vocabulary object detection, and the connection between the motivation and the design is insufficient.
- The related work section lacks sufficient discussion of RGB–IR methods.
- The experimental settings in Section 5.2 are incomplete.
- The main results table compares too few methods and should include more OVD methods.
- The reasoning supporting the claims about model size and generalization in L411 is insufficient.
Questions for authors
See weakness, especially W1, 4.
2 comments
I thank the authors for their response. After reading the rebuttal, my concern on additional OVD baselines is not fully resolved. Therefore I maintain my initial rating.
Responses on Method Motivation and Experimental Evidence
(1) Motivation for Dual-Modal Open-Vocabulary Detection
This work focuses on open-vocabulary detection in low-altitude UAV scenes. Its primary contribution is the UAVOVD dataset, on which the subsequent methods and experiments are built. In complex low-altitude scenes, low light, shadows, and glare can reduce the visibility of object contours and textures in visible images. This affects oriented object localization and weakens the matching between candidate regions and novel-class text descriptions. When thermal contrast is present, infrared images provide complementary structural cues, while visible images retain the texture and appearance details needed to distinguish semantically similar categories.
Therefore, the problem addressed in this work involves not only aggregating information from the two modalities, but also organizing that information to support novel-class detection when novel-class annotations are unavailable. To address this, SGAGF adopts an asymmetric design in which infrared structural information is dominant and visible details provide complementary information. The infrared branch and compensation path preserve infrared object evidence, while the joint gate regulates the injection of visible information. Region–text alignment then associates the fused region representations with category semantics. This design aims to preserve both object structure and fine-grained semantic information.
(2) Related Work on Visible–Infrared Detection
The related work section focuses more on open-vocabulary detection methods and visible–infrared datasets. We will expand the related work to cover UA-CMDet, which uses uncertainty-aware learning; TSFADet, which performs cross-modal spatial alignment; and ICAFusion, which uses cross-attention fusion. These methods primarily study how to use cross-modal information for predefined categories, whereas our work focuses on localizing and recognizing novel objects when detection supervision is available only for base classes.
To the best of our knowledge, UAVOVD is the first RGB–IR bimodal open-vocabulary oriented object detection benchmark for low-altitude scenes. We also propose the corresponding LAOVD framework. Its SGAGF module prioritizes infrared structural information and uses gated fusion to incorporate visible semantic details, followed by region–text alignment. As shown in Table 4, SGAGF improves novel-class mAP50 by 2.03 percentage points over visible-dominant fusion, providing experimental evidence for a fusion design aimed at novel-class detection.
(3) Experimental Settings in Section 5.2
We use the AdamW optimizer with an initial learning rate of 5 × 10⁻⁴, a final learning rate of 5 × 10⁻⁶ (a learning-rate factor of 0.01), and a weight decay of 10⁻⁴. Models are trained for 100 epochs with a batch size of 144 on four RTX 5090 GPUs.
(4) Additional Open-Vocabulary Detection Baselines
Existing open-vocabulary detection methods are evaluated on datasets with horizontal bounding-box annotations. Adapting each method to oriented object detection requires changes to its data-loading pipeline and detection head, which makes the implementation more involved. We have selected Grounding DINO, ViLD, and CastDet as additional baselines. Experiments are currently underway.
(5) Evidence for the Claim in Line 411
The claim in Line 411 is supported by two comparisons: scaling up the model and changing the fusion strategy while keeping the network settings the same. In Table 2, scaling the model from small to medium improves novel-class mAP50 by only 0.29 percentage points. In Table 4, keeping the backbone and training settings fixed while changing from visible-dominant gating to infrared-dominant gating improves novel-class mAP50 by 2.03 percentage points. This improvement results from the change in fusion strategy and cannot be explained by an increase in model size.