- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes a framework for identifying detector-native concept blindspots using DetSAE and analyzing detection degradation across 20 style-transformed images through regression analysis to identify concept clusters associated with systematic detection failures. The identified blindspots are evaluated through activation restoration experiments and incorporated into separately trained FN/FP risk predictors. Experiments across multiple driving benchmarks report improved FN/FP risk prediction performance, while the intervention results demonstrate classification-level improvements rather than reductions in actual detection errors. However, the lack of controlled studies isolating potentially critical factors (e.g., style-transfer artifacts, SAE representation learning, and supervised predictor training) raises concerns about the validity and distinct contribution of the identified blindspots, and it remains unclear whether the reported improvements have any direct implications for reducing actual FN/FP errors or improving detection mAP.
Critical strengths
-
Extensive Evaluation. The paper demonstrates consistent FN/FP risk prediction improvements across multiple benchmarks and domain shifts.
-
Task-Aware Concept Extraction. DetSAE preserves detection-related information, while intervention experiments provide additional evidence of the relevance of the extracted features.
Critical weaknesses
-
Insufficient Blindspot Validation. The paper does not sufficiently establish that the identified blindspots represent meaningful detector-native concepts, as it remains unclear what visual patterns these concepts capture and whether the observed detection failures are actually caused by them. Moreover, detection degradation under style transformations may be influenced by proposal localization shifts, RoI feature misalignment, or geometric artifacts, which are not adequately isolated through controlled experiments. Although the authors show that restoring blindspot activations to their original-image values improves classification accuracy, they do not demonstrate corresponding improvements in actual FN/FP errors or mAP. These limitations weaken the central claim that the identified blindspots explain systematic detection failures.
-
Unclear Blindspot Contributions. The paper attributes FN/FP risk prediction performance to the proposed blindspot mechanism, but several methodological choices and experimental results leave its specific contribution insufficiently validated. For example, Table 5 shows that explicitly adding blindspot channels to all SAE-derived concepts yields only marginal gains in FN risk ranking performance. Since the all-concept representation already includes the identified blindspots, the benefit of explicitly emphasizing them remains unclear. Moreover, although the blindspot-only ablation outperforms randomly selected normal concepts, it is unclear whether the proposed blindspot identification procedure offers advantages over simpler feature selection methods. The use of a separately trained predictor further complicates this assessment, as its performance may reflect supervised learning from FN/FP error labels rather than the ability of the identified blindspots themselves to indicate detection failures. These limitations make it difficult to determine the specific contribution of the proposed blindspot mechanism to the reported results.
Questions for authors
-
Specify the exact clustering procedure, including the similarity measures, merging criteria, and justification for the selected thresholds. Discuss the sensitivity of the identified blindspots to these design choices. More importantly, since the framework relies on both a learned DetSAE representation and a separately trained risk predictor, the reported gains could also be attributed to additional representation learning and supervised prediction rather than the discovery of blindspots. Address this alternative explanation and explain what distinguishes the proposed mechanism from simpler feature decomposition methods, such as PCA/SVD, followed by a trained predictor.
-
Explain how the proposed method distinguishes detection degradation associated with blindspots from changes in proposal localization, RoI feature alignment, or geometric distortions introduced by style transfer. Since detection quality depends on both confidence and IoU, changes in bounding box predictions alone could affect blindspot identification. Specify how object layouts and annotations were verified across the 20 generated styles, and discuss whether these factors could influence the identified blindspots.
-
The intervention experiments demonstrate improvements in frozen-head classification, but their relationship to actual FN/FP errors remains insufficiently established. Explain how these classification-level results support the claimed role of blindspots in detection failures, particularly false positives arising from background regions. Discuss whether the observed effects extend to final detection outputs, including FN/FP errors and mAP, rather than only classification accuracy.
-
Distinguish the contribution of blindspot identification from that of general SAE representations and supervised predictor training. Table 5 shows that explicitly adding blindspot channels provides relatively small gains over using all concepts, although the blindspot-only representation outperforms randomly selected normal concepts. Explain whether the identified blindspots can directly indicate detection risks without a separately trained predictor. Also, discuss the effect of additional style-transformed training data in Ours (MS), given that competing trainable baselines do not use equivalent augmentation.
-
Discuss the generalizability of the proposed framework beyond the evaluated Faster R-CNN architecture. Although the experiments cover multiple datasets and two CNN backbones, they primarily consider Car and Person detection within the same detector family. Explain how the proposed concept extraction and blindspot identification procedures would apply to different architectures, such as YOLO or DETR, and whether the framework depends on characteristics specific to RoI-based detectors.
6 comments
Dear Reviewers,
The authors have addressed your comments in their rebuttal. Please review their responses and provide any further feedback or follow-up questions, if any. Thank you!
Best, AC
Q1. Classic ML alternatives such as PCA match or exceed the proposed approach. This supports the research direction of this work but weakens the motivation for DetSAE-based blindspots. The manuscript should justify in what respect the proposed approach is superior.
Q2. The criteria for verifying layouts and annotations are not specified. The validation thus lacks a grounded basis, which limits the proposed approach's technical soundness.
Q5. The manuscript's experiments can't distinguish whether the achievements stem from the proposed approach's effectiveness or good compatibility with a particular detector family.
Response to Reviewer ohmp
Thank you for your review. References use the revised paper; quotes are excerpts.
Clustering and PCA (Q1)
We report exact clustering, sensitivity tests and PCA predictors.
Similarity weights active-set/top-50/dictionary/prototype agreement 0.30/0.20/0.20/0.30. Complete linkage uses 1−s≤0.70; identity thresholds are 0.05 share and 0.50 mass. Merge thresholds 0.25/0.30/0.35 yield 12/17/19 blindspots from 158 atoms (Sec. 3.1; App. A.1/B.1).
PCA directions use variance or source-error association. At 84 inputs (16 outputs + 17 directions × four statistics), blindspots / the two PCA choices give FN AUROC 78.13/64.03/64.75 on RealDriveSim and 54.38/50.60/51.71 on SIM10K. Four differences pass Holm correction over 96 tests. Full PCA leads all concepts on 5/6 FN AUROC estimates at 420 inputs (App. D.4, Tables 20–23).
Geometry and difficulty (Q2)
The effects remain with proposals and box regression fixed.
Styles were checked for object count, shape, position and annotations; original concept identities are retained. Regression controls original quality, geometry, other concepts and class/style difficulty.
We also control original probability, margin, entropy, their squares and quality squared:
Three pass added controls under joint BH (209 clusters, 20,000 scene resamples); 17/16 use original controls. Head outputs can overlap concept information (App. B.1).
Final detection effects (Q3)
We diagnose and predict failures; restoring selected blindspot activations reduces misses and improves AP.
Diagnosis complements detector improvement by locating likely errors in unlabeled data. Here detector training is unchanged, with weights, proposals and box regression fixed. We compare with the frozen baseline and equal-norm controls, not retraining gains under different constraints. Table 3 (Sec. 4.6): 500 scenes × six non-generative changes, GT/paired originals, decoding/NMS.
AP50/AP50:95 gains (95% CI): 0.3578 [0.2878, 0.4243] / 0.1148 [0.0920, 0.1353] points. Both pass correction over 110 tests with 5,000 paired scene resamples. Direct intervention touches 5.50% of baseline misses, counted per view (App. C.1).
Direct indication and prediction (Q4)
Yes, blindspot identities indicate FN without training a risk predictor.
Match same-image/class GT objects by size/position, independently of outcomes/confidence; threshold 0.5.
All four pass correction over 30 tests. Retained% is matched/eligible blindspot-only objects (App. B.3).
We retrain the 472-input model after linear transforms learned from source data remove blindspot activation information, copies included. Controls target matched normals or normals selected by source errors: 68 directions each. Five random controls match input-change magnitude.
FN AUROC (%); removal columns name the information targeted:
Both losses pass Holm correction over 576 tests. Losses exceed all controls on KITTI, but only normals on RealDriveSim. No C@5 loss passes (Sec. 5.4, Table 5; App. D.1). The 420-input control fixes 16 outputs (D.2, Table 17); shared-style training is in A.3, Tables 7–10.
Other architectures (Q5)
Other detector architectures need further study.
Direct transfer of our method to YOLOv8x yielded no clusters meeting the existing blindspot criteria (App. B.1). Discovery must account for detector architecture; extensions require further study.
We hope this addresses your concerns.