- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SAE-OVOW, a framework for open-world object detection that extracts classagnostic objectness from frozen open-vocabulary detectors without unknown-class annotations or predefined attribute descriptions. A sparse autoencoder is trained on known-aligned region embeddings to learn latent factors. The method selects factors based on activation reliability, distributional similarity measured by Jensen Shannon divergence, and decoder diversity. Selected factor activations are aggregated into an objectness score and combined with known-class uncertainty for unknown detection. Experiments on M-OWODB, S-OWODB, and nu-OWODB demonstrate improvements in unknown-object recall while maintaining competitive known-class performance. Ablation studies, latent interventions, and semantic audits further examine the effectiveness of the selected factors.
Critical strengths
- Meaningful Methodological Contribution. The paper presents a well-motivated approach to extracting class-agnostic objectness from frozen open-vocabulary detectors without unknownclass annotations or predefined attribute descriptions. Learning sparse latent factors directly from region embeddings provides a promising alternative to language-dependent attribute modeling while preserving the original known-class prediction pathway.
- Comprehensive Experimental Validation. The paper provides extensive evaluations across multiple OWOD benchmarks, supported by component ablations, alternative representation comparisons, hyperparameter sensitivity analyses, and robustness experiments. Particularly, the latent removal-and-recovery experiments provide additional evidence that the selected factors are functionally relevant to unknown-object detection, strengthening the empirical support for the proposed approach.
Critical weaknesses
- Missing Comparison with the Closest Related Work. The paper lacks a direct comparison with OW-OVD (CVPR 2025), which employs a closely related JSD-based feature selection and redundancy reduction strategy. Without a controlled comparison, it remains unclear whether SAEderived factors provide meaningful improvements over existing attribute-based representations, weakening the empirical justification for the claimed contribution.
- Insufficiently Controlled Objectness Comparisons. In Table 5(c), alternative objectness branches achieve substantial unknown recall but suffer severe degradation in known-class mAP. Since unknown and known scores compete during post-processing, differences in score calibration may affect these results. Comparisons at matched operating points would better establish whether the improvements stem from superior objectness representations.
Questions for authors
- Relation to OW-OVD. OW-OVD (CVPR 2025) employs a similar JSD-diversity selection strategy and reports higher S-OWODB U-Recall under its own settings. Could the authors clarify the key methodological differences and explain its absence from the comparisons? A matchedbackbone comparison would help establish the added value of SAE-derived factors.
- Contribution to Incremental Detection. In the VOC incremental experiments, the detector remains frozen while new classes are recognized through vocabulary expansion. How much of the reported performance comes from the SAE branch rather than the pretrained detector's zero-shot capability? A baseline without SAE would help clarify this contribution.
### Additional Clarification: Interpretability Beyond Detection Performance
Additional Clarification: Interpretability Beyond Detection Performance
We appreciate your recognition of our latent intervention and semantic audit analyses. We would like to further clarify their significance as evidence supporting an important interpretability contribution of SAE-OVOW.
Our method recovers sparse visual factors directly from frozen OVD representations without predefined attributes or unknown-class annotations. The post-hoc audit identifies coherent visual patterns in 119 of 200 factors, and latent removal-and-recovery experiments establish their functional relevance to unknown detection.
Together, these results provide an interpretable connection between internal visual representations and unknown-object discovery. This contribution complements the incremental detection results by explaining what internal evidence supports the additional objectness branch.
We would appreciate your feedback on this aspect and whether our additional evidence addresses your remaining concerns.