- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates the allocation of computational resources in small-object detection. It introduces the concept of stranded capacity and analyzes the contributions of pyramid depth, channel width, and input resolution. Based on these observations, the authors propose a three-step reallocation strategy that reduces unnecessary capacity and improves detection efficiency without adding new modules.
Critical strengths
- The paper offers an interesting perspective on small-object detection by focusing on resource reallocation rather than introducing additional modules.
- The method achieves impressive improvements in model efficiency while maintaining or improving detection accuracy.
- The experiments are comprehensive, covering multiple datasets, different detection architectures, detailed ablations, and real-world deployment.
Critical weaknesses
- The final configuration is obtained from experiments on VisDrone. Although it transfers well to other datasets, it remains unclear how the proposed allocation rule can be applied to datasets with different object-scale distributions.
- The paper suggests that deep features may introduce background interference into shallow detection layers, but the evidence is mainly qualitative. Further analysis would help support this explanation.
Questions for authors
Please focus on the concerns raised in Weakness.
5 comments
Response 2
Weakness 2 The paper suggests that deep features may introduce background interference into shallow detection layers, but the evidence is mainly qualitative. Further analysis would help support this explanation.
Thank you very much for this suggestion. We fully agree that a single feature map is not enough, so we made the following measurements on the full VisDrone test set (1,610 images).
(a) We quantified what Figure 4 shows. We compared how strongly the cells on targets and the cells on background are activated. For small objects, the signal sent down from the deep levels ranks a target cell above a background cell with probability 0.58–0.63 (0.5 means no separation), against 0.83 for the backbone P2. What Figure 4 shows in one scene therefore holds on the whole test set.
(b) We quantified its effect on the detections. We cut or narrowed the deep context reaching , retrained, and counted the false positives that fall on background (Table j). With P4 at full width, small objects have slightly more background false positives than with P4 at 12.5% of its width (3.9 against 3.7 per image), and APs is slightly lower (11.6 against 11.9). The deep context cannot be removed altogether, however: without it, APs falls to 9.0 and the false positives rise to 10.7 per image.
Table j: APs and background false positives on small objects on the VisDrone test set, with each model thresholded at a small-object recall of 0.40 (mean of one to three seeds).
| Context reaching | GFLOPs | APs | Background false positives on small objects at matched recall (per image) |
|---|---|---|---|
| none | 27.0 | 9.0 | 10.7 |
| P3 | 51.3 | 11.1 | 4.8 |
| P4 (12.5% width) + P3 | 52.7 | 11.9 | 3.7 |
| P4 + P3 (Step 1) | 74.4 | 11.6 | 3.9 |
In sum, these measurements support the observation of Figure 4 and show that the extra width of P4 does not help small objects, while the deep context itself remains useful. This is why our method keeps P4 at 12.5% of its width instead of removing it.
In the revised paper, this quantification will be added as App. F.6 (Table j), and App. B.3 will point to it (changes in blue).
Thank you again for the encouraging and constructive review. We are glad to answer any further questions.
To Reviewer hN9t
Dear Reviewer hN9t,
We sincerely thank you for the time and care you have devoted to our paper, and for your support. Your two suggestions made the scope of the rule clearer and its explanation more accurate.
We hope the two responses above address your concerns. If any point remains unclear, or if further evidence would help, we would be glad to provide it during the discussion.
Thank you again for your careful evaluation. We look forward to your further comments.
Best regards,
The Authors
Response 1
Thank you for the time you put into this review and for your support. We appreciate your positive remarks on reallocating capacity instead of adding modules (S1), on the efficiency gained while accuracy is maintained (S2), and on the experiments across datasets, detector families and deployment (S3).
Weakness 1
The final configuration is obtained from experiments on VisDrone. Although it transfers well to other datasets, it remains unclear how the proposed allocation rule can be applied to datasets with different object-scale distributions.Thank you very much for raising this point. It is a very good one, and we fully agree. We also believe that misallocated capacity is not unique to data extremely skewed towards small objects and must exist in other settings as well, and this is exactly the direction we most want to pursue. Here is what we have explored so far.
Table k: Share of instances ≥64 px and change in AP when one head is closed, for the same architecture trained on each dataset (Table 1; Table e, response to Reviewer 79cX).
In sum, the two measurements above give different results on data with different scale distributions: on small-object datasets the deep heads earn no return and can be removed, while on COCO they are the most valuable and have to be kept. We therefore think that the rule can be applied according to the scale distribution of each dataset, and that it is not tied to the configuration obtained on VisDrone. On a new dataset, the configuration is found again in the same three steps: (1) measure the return of each head and remove the heads that earn none; (2) narrow the deep channel groups one at a time, as far as the measured return allows; (3) spend the released compute on a larger input, until its return falls off. The steps can also be run in the opposite direction if the measured returns point that way, for example lowering the input resolution while widening the deep channels.
In the revised paper, a new appendix (App. F.3) will state how the rule is applied to a new dataset and the scope of the present configuration, with a pointer in §4.2 (changes in blue).