- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the degradation of target representations caused by enlarging the search region in infrared anti-UAV tracking. The authors refer to this issue as search representation dilution, where resizing an enlarged search crop to a fixed input resolution reduces the relative size of the target while introducing additional background information.
To address this problem, the authors propose MSR-Track, which builds upon FocusTrack-SRA and introduces two modules: Lightweight Token Refinement (LTR), which aggregates and redistributes search-token information before template–search interaction, and Multi-Scale Response Enhancement (MSRE), which combines spatial features at multiple scales before bounding-box prediction.
On Anti-UAV410, MSR-Track achieves 62.5% AUC, outperforming the reproduced FocusTrack-SRA baseline by 2.3 points, with relatively small computational overhead. Additional experiments include component ablations, parameter sensitivity, attribute-wise evaluations, and cross-dataset tests on Anti-UAV300 and CST Anti-UAV.
Critical strengths
1、The paper addresses an important issue in infrared anti-UAV tracking, where enlarging the search region improves target coverage but also reduces the relative target resolution and introduces additional background clutter. The proposed modules preserve the existing search policy, input resolution, and prediction interface, making the approach relatively easy to integrate into an established tracking framework.
2、The experimental evaluation covers multiple datasets, component ablations, attribute-wise performance, and computational efficiency. Both LTR and MSRE provide measurable improvements over the reproduced baseline, and their combination achieves the best results. The reported computational overhead is also modest, suggesting practical value for efficient infrared tracking.
Critical weaknesses
1、 The authors explicitly claim that LTR can reduce background-dominant interference before template–search interaction. However, LTR operates only on search tokens (x) without access to the target template (z), and the paper does not adequately explain how it distinguishes target-relevant information from visually similar distractors without target-specific guidance. Meanwhile, the baseline already incorporates global self-attention and a CLS token, yet the paper lacks sufficient justification or controlled comparisons to establish why additional latent aggregation and gated redistribution are necessary. Similarly, the authors claim that the coarse-scale branches of MSRE help suppress structured distractors. However, average pooling and multi-scale feature fusion primarily provide broader spatial context, which does not inherently demonstrate how structured background interference is suppressed. Although the component ablations, attribute-wise evaluations, and qualitative results demonstrate performance improvements, they do not directly verify the claimed interference suppression mechanisms or sufficiently isolate the contributions of these specific design choices from general feature enhancement.
2、The conceptual novelty of search representation dilution is not sufficiently established. The described phenomenon largely follows from the expected consequences of enlarging a search crop while maintaining a fixed input resolution: the target occupies a smaller relative area, and more background clutter is introduced. Although the paper provides a scaling analysis and a search-factor study in Figure 1, it remains unclear what additional insight this formulation offers beyond the known trade-off between search coverage and representation quality.
Questions for authors
1、Given that LTR processes only search tokens before template–search interaction, how does it distinguish target-relevant information from visually similar distractors without access to the target template? Could the authors provide further evidence supporting the claimed interference suppression mechanism and clarify why latent aggregation and gated redistribution are necessary beyond the baseline's existing global self-attention and CLS token?
2、The authors claim that the coarse-scale branches of MSRE help suppress structured distractors. However, broader contextual aggregation does not necessarily imply distractor suppression. Could the authors provide more direct evidence, such as response-map visualizations or distractor-specific analyses, to support this explanation?
3、Beyond the expected reduction in relative target size and increase in background clutter caused by enlarging the search crop, what additional insight does the proposed concept of search representation dilution provide? Could the authors further clarify how this phenomenon differs from the known trade-off between search coverage and representation quality?
4、Given the unresolved 2.1-point AUC discrepancy in the reproduced FocusTrack-SRA baseline, could the authors provide additional verification or evidence supporting the robustness of the reported 2.3-point improvement?
5、Could the authors clarify the detailed training configurations for both stages, including training duration, learning rates, and frozen or trainable components, to facilitate reproducibility and verify the stated consistency of the training protocols?
7 comments
Response to Reviewer GHui – Q2
Q2. The authors claim that the coarse-scale branches of MSRE help suppress structured distractors. However, broader contextual aggregation does not necessarily imply distractor suppression. Could the authors provide more direct evidence, such as response-map visualizations or distractor-specific analyses, to support this explanation?
Response:
We sincerely thank the reviewer for identifying the important distinction between broader contextual aggregation and distractor suppression. We agree that the presence of multiscale branches alone cannot establish that non-target responses are reduced. The comment prompted us to refine both the mechanistic interpretation of MSRE and the scope of our claim.
(1) Function of the multiscale branches. MSRE retains a fine spatial branch and several coarser contextual branches. The fine branch preserves local details required for tiny-target localization, while the coarse branches capture structural relationships over larger spatial extents. Their outputs are aligned to the same dense grid, fused, and written back residually to the original representation. Thus, MSRE directly enables the prediction head to use local responses together with broader context; it is not an explicit distractor-removal operator.
(2) Why broader context may still help. Strong heat sources, edges, and repeated textures can produce local infrared responses similar to those of a tiny target, but their spatial extent and surrounding structure may differ over a larger neighborhood. Multiscale features allow the prediction head to consider both a local peak and its contextual structure, reducing reliance on an isolated response. This is a plausible design motivation, not evidence that every structured distractor is consistently suppressed.
(3) Fixed-input response evidence. To remove trajectory-induced crop differences, all compared variants received pixel-identical template and search crops. The fixed non-target region was selected from the SRA response map and evaluated at the same location for every variant. We compared complete MSRE with SRA and also disabled the coarse branches of the same trained MSRE checkpoint at inference time:
| Metric | Complete MSRE vs. SRA, mean [95% CI] (×100) | Coarse branches ON vs. OFF, mean [95% CI] (×100) |
|---|---|---|
| Target-response gain | +1.18 [−0.57, +3.38] | +1.15 [+0.37, +1.94] |
| Fixed non-target reduction | +1.13 [+0.46, +2.07] | −0.20 [−0.50, +0.05] |
| Target–non-target margin gain | +2.30 [+0.11, +5.05] | +0.94 [+0.03, +1.82] |
The values are raw [0,1] response-score changes multiplied by 100, not percentages or AUC points. The exploratory analysis used 50 fixed frames from 21 sequences. Coarse ON vs. OFF was an inference-time diagnosis, not a separately retrained ablation. Complete MSRE reduced the selected non-target response and improved the response margin on average. For the coarse branches, the stable effects were target-response enhancement and margin improvement; their non-target reduction was not stable. Therefore, the results do not support the claim that every coarse branch directly suppresses distractors.
(4) Evidence boundary and revised claim. Demonstrating suppression of specific categories, such as heat sources, building edges, or cloud textures, would require category-level annotations and measurements at pixel-identical locations. Our current experiments did not include such semantic annotations, so we will not interpret general non-target regions as validated examples of specific physical distractors.
Accordingly, we will replace “the multiscale branches of MSRE suppress structured distractors” with: “MSRE combines local details with multiscale context to enhance the search representation and improve target–non-target separability. This design may help with spatially structured high-response backgrounds, but the current evidence does not support universal suppression across distractor categories.”
Response to Reviewer GHui – Q3
Q3. Beyond the expected reduction in relative target size and increase in background clutter caused by enlarging the search crop, what additional insight does the proposed concept of search representation dilution provide? Could the authors further clarify how this phenomenon differs from the known trade-off between search coverage and representation quality?
Response:
We thank the reviewer for asking how search representation dilution relates to the established trade-off between search coverage and representation quality. We agree that resizing a larger search crop to a fixed input resolution reduces the relative size of the target and brings more background into the input. FocusTrack also discusses feature degradation as the search factor increases. We use the term search representation dilution to describe the representation-quality side of this known trade-off in tiny infrared target tracking. Our focus is on how the tracker uses the limited target information available at a fixed input resolution once the target is within the search region.
Figure 1 of the original submission provided additional empirical evidence. We evaluated FocusTrack-SRA and MSR-Track at search factors of 4, 5, and 6 while keeping the input resolution fixed. Both trackers achieved higher AUC values as the search factor increased. Meanwhile, the AUC gain of MSR-Track over FocusTrack-SRA increased from 1.6 percentage points at a search factor of 4 to 3.0 percentage points at a search factor of 6. Under the tested settings, both widening the search region and enhancing the search representation improved tracking performance, and MSR-Track achieved a larger gain over the baseline at wider search regions.
Changing the search factor affects target coverage, resized target size, and background content together. We therefore interpret Figure 1 as a performance trend observed under their joint variation. In the revised manuscript, we will clarify how the term relates to the established trade-off and frame the contribution as an empirical analysis of the gains from search feature enhancement across search factors.
Response to Reviewer GHui – Q1
Q1. Given that LTR processes only search tokens before template–search interaction, how does it distinguish target-relevant information from visually similar distractors without access to the target template? Could the authors provide further evidence supporting the claimed interference suppression mechanism and clarify why latent aggregation and gated redistribution are necessary beyond the baseline’s existing global self-attention and CLS token?
Response:
We sincerely thank the reviewer for this important question. We agree that, because LTR receives only search tokens before template–search interaction, it cannot identify the true target or suppress an appearance-similar distractor according to target identity at this stage. Target identity is determined by the subsequent template–search interaction. We will therefore describe LTR more precisely as template-independent search-representation refinement rather than as a module that identifies the target before seeing the template.
(1) Latent-token aggregation. Enlarging the adaptive search region introduces more background tokens into a fixed-size input grid, which can dilute the representation of a tiny target. LTR uses eight latent tokens to form multiple complementary summaries of the complete search region. These summaries serve only as internal information carriers: they neither replace nor remove the original 256 search tokens. Consequently, the full dense spatial grid remains available for subsequent template-conditioned matching and localization.
(2) Position-dependent gated write-back. Uniformly broadcasting a single global summary would provide the same supplementary information to every candidate location. Instead, LTR selects a different combination of latent summaries for each search position and writes it back residually. The gates do not determine the target in advance; they condition each candidate representation on its intra-search context, after which the template–search interaction performs target identification.
(3) Relation to global self-attention and the CLS token. Global self-attention provides general token-to-token contextualization, whereas LTR explicitly implements a multi-summary aggregation and position-dependent write-back path. A CLS token represents a single global state and does not explicitly assign different combinations of multiple summaries to individual dense positions. We do not claim that LTR is universally “more necessary” than either mechanism. Rather, it provides a complementary structural bias for background-dominated dense search representations.
(4) Fixed-input evidence. To eliminate trajectory-induced crop differences, we provided all models with pixel-identical template and search crops. The results were:
These values are raw [0,1] response-score changes multiplied by 100, not percentages or AUC points. The exploratory analysis used 50 fixed frames from 21 sequences. The target-response and margin-gain intervals were above zero, whereas the interval for fixed non-target reduction included zero. Thus, the evidence supports stronger target evidence and improved target–non-target separation, but not uniform suppression of every distractor.
Accordingly, we will replace the claim that “LTR suppresses distractors” with the more precise statement that “LTR reorganizes the search representation and improves target–non-target separability after template-conditioned interaction.”