- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes FSD, a VFM-enhanced real-time object detector. It uses a dual-branch backbone: a frozen VFM semantic branch for high-level semantics, and a trainable CNN spatial branch for fine-grained spatial details such as edges, textures, and localization cues. The claim is that VFM-enhanced detection benefits not only from stronger pretrained features, but also from the representational complementarity between VFM semantics and CNN spatial representations.
Critical strengths
-
Strong accuracy–efficiency trade-off FSD achieves state-of-the-art COCO AP across multiple model scales while maintaining fast inference speed. The lightweight FSD-N and FSD-S are particularly strong in balancing accuracy, trainable parameters, and latency.
-
Comprehensive experimental analysis The paper includes ablations on key components, fusion strategy comparisons, VFM generality tests, auxiliary loss weight analysis, cross-device latency measurements, and CKA-based representation similarity analysis. The experimental analysis are solid.
Critical weaknesses
-
Limited technical novelty, mainly engineering integration The method mainly combines existing ideas: frozen VFM + CNN detector, multi-level concatenation, C3k blocks for alignment, and an auxiliary detection head. MSDI and EAH are not fundamentally new mechanisms. The work feels more like careful system design and engineering optimization than a deep methodological breakthrough.
-
Limited experimental scope The main experiments are on COCO. Robustness under domain shift, long-tailed distributions, open-world settings, and specialized visual domains is not thoroughly explored.
Questions for authors
- The “complementarity” insight is intuitive but not deeply theorized The CKA analysis shows a correlation between lower representation similarity and larger gains, but it does not establish causality or provide a predictive principle. The paper does not deeply answer when, why, or how VFM-detector complementarity arises. It would be better if author provide more experimental results to explore it.
- Does the concat + C3k soft alignment in MSDI truly necessary? Could a simpler, more principled, or more lightweight alignment mechanism achieve similar performance? Maybe the author could provide more method comparisons.
- Can the auxiliary loss be made adaptive rather than fixed at 0.5. Can it improve performance?
Point-by-Point Rebuttal to Reviewer BC2s and Revisions
Weaknesses
W1. Technical novelty. While concatenation, C3k, and auxiliary supervision are established operations, FSD's central contribution is a complementarity-driven perspective on VFM-enhanced detection: rather than solely introducing stronger pretrained semantics, we explicitly exploit the distinct strengths of VFM semantics and CNN spatial details. FSD pairs frozen VFM semantics with trainable CNN details; MSDI aligns and propagates features across scales, while EAH guides semantic adaptation. New branch-wise, cross-architecture, and capacity-matched analyses support this motivation (Q1–Q2). See Secs. 1, 3, and 4 of the revised manuscript.
W2. Experimental scope. We further evaluate NEU-DET (varying defect scales and subtle textures) and GC10 (class imbalance and small defects), two industrial benchmarks beyond natural-image detection. FSD achieves 79.4/47.3 AP50/AP50:95 on NEU-DET and 76.2/39.7 on GC10, outperforming all compared CNN/DETR detectors. Against the strongest baseline, YOLO11-S, gains are +2.3/+1.7 and +1.1/+2.2 AP50/AP50:95, respectively. These results support effectiveness in specialized domains.
See the revised Appendix for experimental details.
Questions for Authors
Q1. Understanding complementarity. We agree that CKA measures similarity, not causality. We added branch-wise and cross-architecture analyses to examine complementarity. First, CNN-only has higher small-object AP than EuPE-only (28.7 vs. 24.7), whereas EuPE-only performs better on medium/large objects (56.2/73.5 vs. 51.3/64.1). Integrating both yields 54.9 AP, improving APs by 10.4 and AP75 by 6.9 over EuPE-only. These results support complementary detection strengths
Second, cross-architecture comparisons and CKA show that CNN detectors exhibit lower similarity to VFM features and are associated with larger gains than Transformer detectors. Additional EuPE improves DEIMv2-S from 50.9 to 52.7 (+1.8 AP), whereas the full FSD-S improves YOLO11-S from 46.6 to 54.9 (+8.3 AP). Though architectures and integration differ, the results support our hypothesis.
We hope these results clarify complementarity. See Secs. 4.3–4.4 of the revised manuscript
Q2. Alignment alternatives. Using the same EuPE levels (E3–E5), we compare Add, Concat, and capacity-matched High-channel Concat (HC-Concat) with MSDI. Add/Concat reach 52.8/52.9 AP, whereas MSDI reaches 53.3 AP. HC-Concat reaches 52.6 AP with 5.378M trainable parameters versus MSDI's 5.425M, indicating gains beyond increased fusion capacity. Removing Cross-scale Complementary Feature Propagation (CFP) reduces AP to 48.9 (−4.4), underscoring hierarchical interaction.
These comparisons support our design choices. See Sec. 4.3 of the revised manuscript.
Q3. Adaptive auxiliary weight. We initially tried making λaux learnable during training; FSD-N achieved 53.2 AP, below 53.3 AP with fixed λaux=0.5. As this task-level weight is easily tuned, we select fixed 0.5 for simplicity after sensitivity analysis
Due to the character limit, our full point-by-point responses and additional experimental details are provided in the supplementary material