- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces QAD-D-FINE to improve the detection of dense, small-scale objects. It employs two key mechanisms: Query-Adaptive Sampling (QAS), which incorporates P2 features and dynamically scales deformable sampling offsets based on query-specific scales and confidence levels and Matching-based Redundant Query Suppression (MRS), a loss function applied during training to penalize redundant responses. QAD-D-FINE achieves consistent performance gains on the VisDrone, SODA-D, and UAVDT datasets with an increase of only about 0.1M parameters.
Critical strengths
(1) MRS suppresses redundancy at zero inference cost. It operates only during the training phase on unmatched queries, leaves the core one-to-one matching mechanism intact, and does not enter the inference graph.
(2) Randomly permuting the \gamma factors for each query within the same image preserves the marginal distribution of \gamma, directly demonstrating that the gains stem from the "correspondence between the scaling factor and the query state," rather than from shift normalization or changes to the global sampling radius.
Critical weaknesses
(1) Adding a P2 high-resolution branch to a detector to handle small objects has become a standard practice for improving YOLO/DETR-based models since 2020; as early as 2024, DQ-DETR [1] incorporated five-scale feature maps into a DETR-style architecture for the detection of tiny objects. QAS primarily enables the sampling range to vary according to the query state. However, BoxR [2] has proposed query conditioning and scaling the sampling range in proportion to the box scale. Therefore, the contribution of QAS is minimal and incremental.
(2) Using the Hungarian matching results as an anchor, the MRS method of applying "soft negative sample suppression" to unmatched queries of the same type is essentially equivalent to assigning soft labels or designating "ignore regions" (similar to the approaches in FreeAnchor [3] or ATSS [4]) for negative samples that lie close to positive samples.
(3) The core motivation behind MRS is that unmatched queries (following one-to-one matching) tend to cluster around already-matched targets, leading to redundant responses. It is precisely the issue addressed by DDQ [5]. Furthermore, "one-to-many" auxiliary assignment approaches (such as Group DETR [6], H-DETR [7], etc.) are conceptually related to the "matching relationship reuse" mechanism in MRS. However, these works are entirely absent from the "Related Work" section, and no comparative experiments involving them have been conducted.
(4) The motivation behind introducing P2 in QAS is to mitigate the loss of detail in small objects caused by downsampling. However, the standard practice for addressing this same issue is simply to increase the input resolution. While the paper compares QAS@640 with D-FINE@640, it fails to provide performance curves for D-FINE at higher resolutions, such as 768 or 896. Table 2 indicates that QAS comes at the cost of an 18% increase in latency (from 5.1 ms to 6.0 ms). This is on the same order of magnitude as the cost incurred by moderately increasing the input resolution.
(5) The score, defined as \text{IoU} + \exp(-q), raises several questions: Why are the distance term and the IoU term added rather than multiplied? Why is this mechanism applied only to ground-truth (GT) objects that are small (and why is there no need to suppress redundant queries for large objects)? Furthermore, why is it applied exclusively to the final decoder layer, whereas D-FINE’s auxiliary losses are distributed across all layers? None of these design choices have been subjected to an ablation study.
[1] DQ-DETR: DETR with Dynamic Query for Tiny Object Detection
[2] BoxeR: Box-Attention for 2D and 3D Transformers
[3] FreeAnchor: Learning to Match Anchors for Visual Object Detection
[4] Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selection
[5] Dense Distinct Query for End-to-End Object Detection
[6] Group DETR: Fast DETR Training with Group-Wise One-to-Many Assignment
[7] DETRs with Hybrid Matching
Questions for authors
[1] What are the primary innovations of this paper? The authors should elaborate on them in detail and provide sufficient experimental evidence to support their claims.