- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies the degradation of novel-category detection when a pretrained YOLO-World-L v2.1 model is adapted using ground-truth annotations only for base classes. On OV-COCO, base-only fine-tuning reduces novel AP50 from 68.0 to 25.7. The authors interpret this degradation as suppression of foreground and category-discriminative knowledge and propose KR-OVD with two recovery pathways: novel-category pseudo-labels generated by a frozen YOLO-World teacher, and ICA-PAN, which combines inter-class text attention with text-guided visual feature fusion. Experiments on OV-COCO and VisDrone2019-DET report base/novel AP50 of 66.5/50.7 and 40.2/17.9, respectively. Ablations examine the contributions of pseudo-supervision and the architectural components.
Critical strengths
The paper reports both base- and novel-category performance before and after adaptation, making the loss of pretrained capabilities explicit. The pseudo-label-only and ICA-PAN-only ablations also help distinguish the empirical contributions of the two components.
Critical weaknesses
- Limited evidence for the recovery mechanisms.
- The paper shows partial recovery over base-only adaptation, but does not compare against preservation strategies applied to the same pretrained checkpoint, such as feature- or logit-level distillation from the frozen model, partial freezing, or weight regularization/interpolation. Comparisons with heterogeneous OVD models do not establish a better adaptation–retention trade-off.
- On OV-COCO, pseudo-labeling alone achieves 67.5/50.5 base/novel AP50, while the full method achieves 66.5/50.7. Thus, standard pseudo-labeling accounts for nearly all the novel-category improvement. ICA-PAN helps when combined with pseudo-labeling on VisDrone, but alone reduces novel AP50 from 13.6 to 4.7.
- These results support a dataset-dependent architectural benefit, but do not establish base-to-novel semantic transfer as its cause. Controls isolating cross-category interaction and variability estimates for small gains, such as ICTE’s 0.7 novel AP50 improvement, are needed.
- Unequal supervision assumptions and limited validation.
- KR-OVD uses the exact evaluation novel-class list to generate category-specific training labels, so it receives direct supervision for precisely the classes on which it is evaluated. NoOVD does not require this list, while MSPL generates region labels without a predefined novel vocabulary. Table 2 does not distinguish these materially different assumptions, so its reported margins cannot establish methodological superiority under comparable conditions.
- Evaluation covers only 17 novel classes on OV-COCO and 3 on VisDrone, omitting OV-LVIS without explanation. No experiment tests retention of categories excluded from pseudo-label generation or robustness to inference vocabulary changes. The evidence therefore remains limited to a small, explicitly targeted novel vocabulary.
Questions for authors
-
OV-LVIS, the standard benchmark used by NoOVD and other OVD work, is not evaluated, and the paper does not explain why. The indirect pathway models relationships across the whole input vocabulary, yet it is validated only at a limited vocabulary scale (65 OV-COCO and 10 VisDrone classes). Could you report OV-LVIS results (e.g., AP on the 337 rare classes), or explain why it was excluded? This would show whether ICTE and SoftmaxGate still help with a large vocabulary and a long-tailed class distribution.
-
ICTE and SoftmaxGate make each category’s features depend on the other categories in the input vocabulary. Does ICA-PAN retain its benefit when this vocabulary changes? For example, please compare novel-category AP under novel-only and standard base-plus-novel prompts for both KR-OVD and the original YOLO-World baseline.
-
Could you generate pseudo-labels for only a subset of novel classes and compare performance on the remaining novel classes against base-only fine-tuning? In particular, does training with these pseudo-labels cause additional degradation on novel classes that receive no pseudo-label supervision?