- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes SFMT, a spatial-frequency collaborative framework for single-object visual tracking. Its Frequency-Domain Awareness (FDA) module models temporal phase information using Mamba and uses the resulting features to guide amplitude filtering. A Spatial-Frequency Fusion (SFF) module combines global sequence-level interaction with local point-wise interaction, followed by a multi-scale decoder for target localization. Experiments on six benchmarks show competitive performance, including 74.1% AUC on LaSOT and 77.2% AO on GOT-10K. The reported ablations support the effectiveness of the overall design, although the evidence for the proposed motion-modeling mechanism remains incomplete.
Critical strengths
- The paper investigates temporal phase information as a complement to spatial appearance features. This is a meaningful direction for tracking under appearance changes and motion-related disturbances. The separation of phase modeling, amplitude filtering, and spatial-feature fusion provides a coherent design rationale.
- FDA, SFF, and the multi-scale decoder address distinct stages of the tracking pipeline. In particular, combining global interaction with local correspondence is a reasonable way to integrate the two feature branches. The architecture presents a concrete implementation of spatial-frequency collaboration rather than relying on frequency information only as an auxiliary training signal.
- The paper evaluates SFMT on six datasets. It achieves the highest LaSOT AUC among the methods listed in Table 1 and remains close to the leading reported results on TrackingNet and UAV123. This breadth of evaluation provides useful evidence that the approach is not effective only on a single benchmark.
Critical weaknesses
- Table 3 only adds FDA, SFF, and the decoder in a fixed order. It does not separate temporal phase modeling from amplitude filtering, additional historical information, or increased model capacity. Comparisons against current-frame-only phase processing, guidance-free amplitude processing, and a capacity-matched spatial branch are missing. Similarly, the global/local fusion paths and the decoder’s multi-scale and gating components are not evaluated separately.
- Equation (2) constructs a global sequence with (2N_x) tokens but subsequently reshapes the Mamba output into an (H\times W\times C) feature map without explaining how the token count is reduced. Figure 3 also depicts an addition operation in the amplitude path, whereas Equation (1) specifies multiplicative gating. The use of the original phase for inverse FFT is not clearly reflected in the diagram. Furthermore, the subsequent use of template features is insufficiently described.
- The robustness and scope of the performance gains remain unclear. The LaSOT improvement over DreamTrack is 0.3 percentage points, but no repeated-run variability is reported to contextualize this margin. SFMT also trails the best listed methods by 4.3 points on GOT-10K AO and 5.1 points on TNL2K AUC.
Questions for authors
Please see weakness above.