- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
Introduced the Single-Domain Generalizable Open World Object Detection (SG-OWOD) setting, where a detector trained on a single labeled source domain must preserve its open-world capability across multiple unseen target domains and also perform class incremental learning. They performed analysis of vision language based OWOD baselines and revealed two major bottlenecks. First, severe feature drift across the backbone, accompanied by weaker known class responses under domain shifts, and background affected the unknown discovery. So, they proposed RADAR to maintain known class detection across domains and removed effect of background to improve unknown class detection to operate reliably across unseen domains.
Critical strengths
- Tackles an important problem setting SG-OWOD by bridging the gap between open-world object detection and domain generalization to handle real-world distribution shifts using training data from only a single source domain.
- Lightweight adaptation to address feature drift problem using CLA.
- Filters out background clutter to improve unknown class detection.
- Comprehensive empirical analysis over 3 types of shifts, to show improvement on distribution shifts and class incremental learning.
Critical weaknesses
- CLA doesnt improve robustness as it improves the clean source domain about as much as the target domain. At source Task 4, K-mAP goes from 47.0 to 59.6, and previous class AP from 45.3 to 61.4. Relative robustness metrics could help show the improvement on target domain better.
- It lacks on the evaluation of real world datasets like OdinW, flickr etc, also LVIS would be better to evaluate for unknown class detection. Since YOLO-World is pretrained on data that includes coco unknown classes content, as object365 consists of many overlapping coco classes. -The OVOW+DivAlign on COCO-DC is drastically worse than OVOW alone, which is unexplained. Also there are several other baselines that are missing, like simple strong augmentation AugMix on OW-OVD, full or partial fine-tuning without lora, and other VLM-based OWOD methodsthat the paper cites, such as OW-VAP and YOLO-UniOW.
- findings of earlier layer suffering from distribution shifts and background affecting the unknown detections are not novel, and proposed method to improve robustness is not clearly proved.
Questions for authors
- Could you evaluate the relative robustness metrics for all the methods and component ablations?
- How does RADAR perform on benchmarks with natural domain shift, like ODinW, and on an unknown-class evaluation with categories less covered by pretraining, likein the LVIS rare split? -Several baselines are missing like OW-OVD with strong augmentation such as AugMix, OW-OVD with full or partial fine-tuning without LoRA, OW-OVD+DivAlign and the VLM-based OWOD methods like OW-VAP and YOLO-UniOW.