- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Counterfactual Query-Trajectory Reliability (CQTR), a training-free framework for improving small-object detection with frozen DETR-based detectors. It combines counterfactual scale inference, decoder-trajectory reliability estimation, cross-scale semantic conflict correction, and unlabeled stream routing. Experiments across nine detectors and three datasets show consistent improvements in AP and APs without parameter updates.
Critical strengths
1.The paper explores an interesting training-free perspective on small-object detection by investigating latent capabilities in frozen detectors.
2.The framework is applicable to nine detectors with different query mechanisms, demonstrating broad architectural compatibility.
3.The decoder-trajectory analysis provides useful insights into spatial convergence and semantic persistence.
4.The experiments cover multiple datasets and include component ablations and interpretability analyses.
Critical weaknesses
1.Limited contribution beyond scale augmentation. Table 1 shows that counterfactual scaling accounts for nearly all performance gains. The complete framework improves over scale-only inference by just 0.03, 0.05, and 0.10 AP on COCO, TinyPerson, and VisDrone, respectively. This weakens the claimed methodological contribution.
2.Insufficient justification for trajectory reliability. Spatial convergence and semantic persistence are heuristic indicators. Incorrect predictions may also remain stable across decoder layers. Comparisons with simpler confidence- or uncertainty-based reliability measures are missing.
3.Limited validation of the routing strategy. The routing mechanism relies on manually chosen thresholds and selects a fixed correction branch for each model-dataset combination. Its robustness to threshold choices and calibration subsets remains unclear.
4.Insufficient efficiency analysis and baseline comparisons. CQTR requires additional high-resolution inference, potentially increasing computational costs. Comparisons with standard multiscale inference, high-resolution testing, and slicing-based approaches under matched computational budgets are needed.
Questions for authors
1.What evidence demonstrates that trajectory-based correction provides substantial benefits beyond counterfactual scaling?
2.How does trajectory reliability compare with confidence- or entropy-based alternatives?
3.How sensitive is stream routing to its thresholds and calibration subsets?
4.What are the inference costs compared with conventional multiscale approaches?
6 comments
Response to Weakness 2 and Question 2
We thank the reviewer for suggesting these comparisons. We have added an appendix subsection, “Comparison with Confidence and Entropy-Based Reliability Measures,” reporting controlled experiments with frozen RT-DETR-R50 on all 5,000 COCO val2017 images. We compare final confidence, binary-entropy certainty computed from all 80 sigmoid class responses, and trajectory evidence. All methods use identical native and counterfactual predictions, candidate budgets, fusion procedures, and postprocessing. Each reliability measure is inserted into the same score-recalibration rule with a fixed strength of . Stream-level branch selection is disabled. We also verified the correspondence of all 273,920 eligible candidates with the original diagnostic cache, including matching labels, confidence scores, and trajectory evidence. Ground truth is used exclusively for evaluation and post hoc analysis. As reported in Table 13, scale-only inference achieves 54.1826 AP and 38.5090 APs. Confidence recalibration achieves 54.2305 AP and 38.6005 APs, while trajectory evidence achieves 54.2314 AP and 38.6475 APs. Binary-entropy certainty yields 54.1759 AP and 38.5088 APs. Thus, trajectory evidence performs comparably to confidence recalibration in overall AP and yields slightly higher small-object AP. We do not interpret the 0.0009-point AP difference as a meaningful performance advantage. We additionally examine localization-quality discrimination among 10,523 one-to-one matched small-object predictions, defining high-quality localization as IoU ≥ 0.90. Table 14 reports an AUROC of 0.7340 for trajectory evidence, compared with 0.7215 for confidence and 0.4631 for binary-entropy certainty. These results support trajectory evidence as a localization-quality indicator within the matched subset. Overall, the added comparisons support a qualified conclusion: trajectory evidence provides useful localization-quality information, but its realized detection benefit under the current recalibration rule is modest and broadly comparable to confidence recalibration. We have clarified this distinction in the appendix. We also specify that these results concern a shared recalibration rule with fixed β, rather than separately optimized settings for each measure.
Response to Weakness 3 and Question 3
We thank the reviewer for requesting a broader evaluation of routing sensitivity. We have added the appendix subsection “Sensitivity and Selection Accuracy of Unlabeled Routing,” covering all 27 model–dataset combinations. We vary the calibration subset size over M in {25,50,100,200}, use five random seeds, and independently perturb each of the two routing thresholds by −10%, 0%, and +10%. This produces 180 configurations per model–dataset combination and 4,860 configurations in total. For each seed, smaller calibration subsets are nested within the corresponding 200-image subset. All calibration images come from the training split and are used without annotations. Detector parameters and correction rules remain fixed. Across these configurations, 4,444 of 4,860 routing decisions (91.44%) agree with the default decision obtained using 100 images, seed 31415, and the original thresholds. This indicates that routing decisions are usually stable under the tested variations in subset size, sampling seed, and thresholds. This agreement measures stability relative to the default route, rather than selection accuracy. To assess selection accuracy separately, we evaluate both correction branches on each complete evaluation split. The default router selects the higher-AP branch in 19 of 27 combinations (70.37%). We also report AP regret, defined as the AP difference between the better branch and the selected branch. Mean regret is 0.0342 AP points, and maximum regret is 0.2897 points. The largest discrepancy occurs for DAB-DETR on COCO, where the selected conflict branch achieves 37.9431 AP, compared with 38.2328 AP for trajectory recalibration. Evaluation annotations are used only for this retrospective assessment and do not influence calibration or routing. These results show that the router is usually stable within the tested perturbation range, while incurring a small average AP regret. However, it does not consistently select the optimal branch. We therefore clarify that the router is a heuristic supported by these experiments, rather than a guarantee of optimal branch selection, and distinguish routing stability from selection accuracy throughout the revised discussion.
Response to Weakness 1 and Question 1
We thank the reviewer for highlighting this distinction. We agree that counterfactual scaling accounts for most of the detection gains. On RT-DETR-R50, the selected reliability correction adds only 0.03, 0.05, and 0.10 AP over scale-only inference on COCO, TinyPerson, and VisDrone, respectively. These results do not establish a substantial AP contribution from trajectory correction, and we have revised our claims accordingly. To clarify whether trajectory evidence nevertheless provides information beyond final confidence, we added two complementary analyses on all 5,000 COCO val2017 images. First, we evaluated 273,920 eligible small-object candidates using score-ordered, one-to-one, same-class matching at IoU ≥ 0.5, counting duplicate predictions as false positives. Across trajectory-evidence quintiles, matched-positive rates increase monotonically from 0.58% to 12.32%. After controlling for final confidence, predicted box area, class, and local crowding using image-grouped five-fold cross-validation, adding trajectory evidence increases AUROC by 0.000691, with a 95% image-bootstrap confidence interval of [0.000278, 0.001045]. This indicates a positive but small incremental predictive contribution. Second, among the 10,523 matched predictions, mean IoU increases from 0.692 to 0.843 across evidence quintiles, and the proportion achieving IoU ≥ 0.75 rises from 34.49% to 84.27%. The partial rank correlation remains positive after controlling for the same variables, at 0.158 [0.137, 0.179]. This supports trajectory evidence as a complementary indicator of localization quality among matched predictions. However, our current correction adjusts confidence scores rather than box coordinates, and its realized AP benefit remains modest. We therefore distinguish the primary performance gains from scaling, the diagnostic information supplied by decoder trajectories, and the limited additional gains achieved by the current correction rule. We have revised the abstract, introduction, contributions, and conclusion to reflect this distinction, and report the additional analyses in Section 4.5 and Appendices A.4–A.5.