- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ProCreDet, a teacher-student framework for sparsely annotated underwater object detection, where many objects remain unlabeled during training and may incorrectly be treated as background.
The method introduces three components: (1) Risky Sample Filtering (RSF), which dynamically separates reliable positives, uncertain samples, and likely negatives based on teacher confidence distributions; (2) BiMask, which encourages complementary feature learning under different underwater color augmentations; and (3) Conflict Mitigator (CM), which suppresses misleading teacher predictions while retaining useful inter-class information for student supervision.
Experiments on UODD and DUO under different annotation sparsity levels demonstrate improvements over existing methods. With 70% of annotations removed, the YOLO-based implementation achieves 47.2 mAP on UODD and 54.0 mAP on DUO, exceeding the strongest reported competing baselines by 7.6 and 4.9 mAP points, respectively. Ablation studies further support the contributions of the individual modules, particularly RSF, to detection accuracy and training stability.
Critical strengths
-
Effective handling of missing annotations. The proposed RSF module addresses an important weakness of sparsely annotated object detection: incorrectly treating unlabeled foreground objects as negatives. The interval-purity analysis in Table 6 and the ablation results in Table 7 provide meaningful evidence that filtering uncertain samples improves performance.
-
Strong experimental improvements under high annotation sparsity. The method achieves substantial improvements on both UODD and DUO, particularly when 70% of annotations are removed. The results across multiple sparsity levels, together with the reported improvements in training stability, demonstrate practical value.
-
Complementary components with useful ablations. The combination of RSF, BiMask, and CM addresses different challenges in underwater object detection. The ablations demonstrate measurable contributions from the individual components. Furthermore, inference requires only the teacher detector, avoiding additional inference-time branches.
Critical weaknesses
-
Limited methodological novelty. The framework primarily combines established techniques, including teacher-student learning, confidence-based pseudo-label filtering, feature masking, and consistency regularization. Although the integration is effective, the paper does not sufficiently distinguish its contributions from simpler alternatives. In particular, comparisons against fixed or percentile-based filtering and standard feature dropout would help establish whether the proposed mechanisms provide improvements beyond existing approaches.
-
Insufficient justification of the statistical assumptions and loss formulation. RSF estimates Gaussian confidence statistics independently for each batch while jointly modeling all categories (Section 3.2). Given the small batch size of two images and the bounded nature of confidence scores, the reliability and calibration of these thresholds deserve further investigation. Moreover, the K-S test uses parameters estimated from the tested samples, making the reported asymptotic p-values potentially inappropriate without correction. Separately, Equations (7)-(10) describe KL divergence directly on logits without clearly specifying normalization and the order of masking and loss reduction. These ambiguities affect reproducibility and the interpretation of the proposed objectives.
-
Limited evidence of generalization and comparison fairness. The experiments use only two underwater datasets with artificially removed annotations, leaving performance under naturally incomplete annotations unverified. Comparisons also involve different detector architectures and training configurations, making it difficult to isolate architectural advantages from those of the proposed method. Although matched-backbone ablations are provided, stronger controlled comparisons and quantitative cross-domain evaluation would better substantiate the generalization claims.
Questions for authors
Can the authors compare RSF against simpler alternatives, such as fixed confidence thresholds, percentile-based filtering, or moving-average thresholds, while keeping the negative sampling ratio identical? This would help establish the specific contribution of the proposed Gaussian-based selection.
-
How stable are the estimated Gaussian parameters across batches and categories, particularly with batch size two? Additionally, how are the K-S p-values calculated when the Gaussian parameters are estimated from the same observations?
-
Could the authors clarify the implementation of the KL divergence in Equations (7)-(10)? Specifically, are the logits normalized before computing KL divergence, and are the sample masks applied before or after loss reduction?
-
Can the authors provide additional matched-architecture comparisons and evaluate the approach under naturally occurring annotation sparsity or quantitative cross-dataset transfer? Such evidence would strengthen the claims concerning robustness and generalization.