- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This paper applies the e-BH procedure to filtering predictions from frozen open-vocabulary detectors. It proposes block calibration to control the expected false discovery proportion averaged across queries. Extensive experiments with GroundingDINO and YOLO-World on COCO, LVIS, and Open Images compare the proposed method with existing baselines in terms of false discovery control, precision, and recall, highlighting the trade-offs between suppressing false detections and retaining true objects.
Critical strengths
The paper effectively integrates e-value-based FDR control into OVD through image-block calibration. By accommodating score-dependent candidate counts and within-image dependence, it provides a principled approach to suppressing false detections without retraining the detector.
The theoretical analysis is well developed, with explicit assumptions and detailed derivations of the FDR guarantees and release conditions. These results support the statistical foundation of the method and explain how evidence strength, candidate count, and rank influence which detections are retained.
Critical weaknesses
The writing lacks clarity and makes the paper difficult to follow. Although the task is formally defined, its practical motivation and relationship to prior work are insufficiently explained. This makes it difficult to understand the intended application and assess the contribution beyond existing FDR methods.
The results in Table 2 and Figure 3 do not show consistent improvements over Monotone CRC, leaving the practical benefits of the proposed method unclear.
The prompt-bank experiment raises concerns about scalability. With 40 calibration images, recall drops from 43.62% to 2.04% as the prompt count increases from 80 to 1,280 (Figure 6). This substantial loss of useful detections limits the demonstrated applicability to larger prompt banks.
The FDR guarantee assumes a fixed α, but the adaptive procedure in Section 4.1 selects α using the calibration data. The paper does not establish whether FDR remains controlled after this selection.
Questions for authors
Could the authors clarify the additional benefit of the proposed method over Monotone CRC, given the results in Table 2 and Figure 3?
Reply to authors
I thank the authors for their efforts to address my questions. They have provided some new results to support the performance. However, the reply for contribution is still unconvincing, it is recommended the authors to summarize any technical or theoretical contributions over previous approaches. Besides, my largest concern is still the paper quality, which is not improved in this rebuttal.