- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents SEDEIM, an extension of DEIMv2 aimed at improving small-object detection in general scenes. The authors observe that many missed small objects are already covered by selected queries, suggesting that query coverage is not the only bottleneck. They introduce three modules to improve spatial detail extraction, multi-scale feature fusion, and localization refinement.
Critical strengths
-
The paper identifies a meaningful failure mode beyond query coverage.
-
Consistent improvements across model scales provide credible empirical evidence.
Critical weaknesses
-
whether the added architectural complexity is justified by the improvements. For example, SEDEIM-M increases FLOPs from 52.3G to 67.9G while improving AP from 53.0 to 54.2. This is a meaningful gain, but without a compute-matched baseline, it is difficult to tell how much comes from the proposed mechanisms rather than additional processing capacity.
-
limited novelty with weak evidence for the core causal claim. The three components mostly build on existing techniques (CNN spatial adaptation, bidirectional fusion, attention refinement); the contribution is an effective architectural combination rather than a distinct new method.
Questions for authors
-
Would SEDEIM still outperform a simpler DEIMv2 variant with comparable FLOPs?
-
Are the improvements particularly pronounced for small objects surrounded by larger or densely packed instances, as suggested by the motivation?
5 comments
W2 & Q2 (Crowded-scene Verification):
SEDEIM delivers larger detection gains for small objects with more neighboring instances, with AP gains increasing from 0.4 points for isolated objects to 1.9 points for those with at least four neighbors.
We report APs and AP75s stratified by neighborhood instance count.
Specifically, following the spatial neighborhood defined in Appendix E.2, we expand each target box by a factor of 2.5 in both dimensions about its center and exclude the target box itself. Other valid annotated instance boxes with positive-area intersection with this ring are counted as neighbors, regardless of category or size. We partition all 15,264 valid small objects into groups with 0, 1, 2–3, and at least 4 neighbors and evaluate detections on the complete COCO val2017 set. Group membership depends exclusively on ground-truth geometry, without using feature measurements or detection outcomes.
SEDEIM-S improves AP over DEIMv2-S by 0.4, 0.8, 1.3, and 1.9 points, respectively, across the four neighborhood-count groups. The corresponding AP75 gains are 0.2, 0.8, 1.3, and 3.0 points. Aggregating objects with at least one neighbor yields a gain of 1.9 AP, compared with 0.4 AP for objects without neighbors in the ring. The subgroups with at least two small-object neighbors and with larger-instance neighbors improve by 2.0 and 1.7 AP, respectively. These results provide detection-level evidence, independent of our custom feature diagnostics, that the gains are more pronounced in neighboring and densely populated regions. They support our crowded-scene motivation without relying solely on improvements in the analysis metrics.
| Neighborhood Group | Small Objects | DEIMv2-S APs | SEDEIM-S APs | DEIMv2-S AP75s | SEDEIM-S AP75s |
|---|---|---|---|---|---|
| 0 neighbors | 2,137 | 19.0 | 19.4 (+ 0.4) | 20.8 | 21.0 (+ 0.2) |
| 1 neighbor | 3,514 | 25.5 | 26.3 (+ 0.8) | 28.1 | 28.9 (+ 0.8) |
| 2-3 neighbors | 5,387 | 20.4 | 21.7 (+ 1.3) | 21.6 | 22.9 (+ 1.3) |
| ≥4 neighbors | 4,226 | 22.1 | 24.0 (+ 1.9) | 21.8 | 24.8 (+ 3.0) |
| ≥1 neighbor | 13,127 | 30.4 | 32.3 (+ 1.9) | 32.5 | 34.9 (+ 2.4) |
| ≥2 small-object neighbors | 5,632 | 20.4 | 22.4 (+ 2.0) | 21.2 | 23.0 (+ 1.8) |
| ≥1 medium/large-object neighbor | 8,951 | 28.4 | 30.1 (+ 1.7) | 29.9 | 32.2 (+ 2.3) |
Dear Reviewer 4Due,
Thank you again for your detailed review. As the discussion phase ends on November 18 (AoE), we would like to confirm whether our responses have addressed your concerns. In summary, our responses include comparable parameter analysis, discussion and clarity of our novelty, and crowded-scene verification.
We are happy to discuss any remaining questions. If our responses and the revised paper have addressed your concerns, we would be grateful if you would consider updating your evaluation.
Sincerely, The Authors
We thank the reviewer for recognizing the strengths of our work, identifying its weaknesses, and providing constructive suggestions for improvement.
W1 & Q1 (Comparable Parameter Analysis)
Under comparable parameter and computational budgets, SEDEIM achieves clear gains over capacity-expanded DEIMv2-S baselines, demonstrating the benefits of our proposed mechanisms beyond simply increasing model capacity. Specifically, we evaluate straightforward capacity-expanded DEIMv2-S baselines by widening the original adapter CNN, the existing encoder fusion blocks, and both. Results are shown below
These capacity-expanded variants achieve 51.1, 51.2, and 51.3 AP, respectively, compared with 50.9 AP for DEIMv2-S. Their small-object AP values are 31.8, 31.4, and 31.7, whereas using our SEA and CDP achieves 51.7 AP and 32.0 APs and whole SEDEIM-S achieves 51.8 AP and 33.1 APs. Thus, ordinary capacity expansion recovers part of the improvement, but SEDEIM retains an advantage of 0.5 AP over the strongest overall capacity baseline and 1.4 APs over the strongest small-object capacity baseline.
W2 (Novelty)
SEDEIM introduces a problem-driven, coordinated design for preserving small-object distinctions and translating them into accurate localization. Its motivation is the gap between spatially covering a small object and obtaining an instance-specific representation that supports its detection.
The novelty is embodied in three specific information-processing mechanisms. SEA spatially modulates the CNN detail contribution using both semantic and detail responses. CDP extracts a separately projected local-contrast correction before mixing it with incoming cross-scale context. LER constructs a localization residual from the difference between localization-oriented and native scale allocations. Together, these mechanisms address how small-object information is introduced, preserved, and used for localization across successive detector stages.
The capacity-controlled experiments distinguish these mechanisms from straightforward architectural expansion. With the same reported 9.8M parameters and nearly identical FLOPs, SEA exceeds a wider-adapter baseline by 0.3 AP and 0.9 APs. The complete SEDEIM-S exceeds the jointly widened adapter-and-encoder baseline by 0.5 AP and 1.4 APs while using slightly fewer parameters. These comparisons establish benefits beyond simply increasing parameter capacity.
The interaction experiments (W2 & Q2 replied to Reviewer pGBb) further identify the functional contribution of the integrated design. Adding LER to SEA+CDP increases APs from 32.0 to 33.1 and AP75s from 34.1 to 35.4 while maintaining APm at 56.0. Controlled residual interventions additionally reveal that the effects of SAF modulation and CSDP local correction depend on one another. These results support complementary representation enhancement and localization refinement rather than an assumption of independently additive gains.
Independent detection results substantiate the targeted crowded-scene benefit. Under GT-defined neighborhoods, APs gains increase from 0.4 points for isolated small objects to 1.9 points for those with at least four neighbors. The crowded-small-object and medium/large-neighbor subgroups gain 2.0 and 1.7 APs, respectively. These neighborhood-stratified detection results complement the feature analyses and provide direct evidence that SEDEIM benefits the instance configurations motivating its design.