- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This article proposes a lightweight Transformer method W2Track for underwater single target tracking, which adjusts calculation allocation through two modules. Stage aware Attention Interaction uses asymmetric templates for search interaction in the shallow layer, while retaining only bidirectional cross frame attention in the deep layer. Adaptive Layer Execution uses intermediate features to predict layer execution probability and adjusts the deep layer execution threshold based on cross frame attention entropy. Accuracy, speed, and computational complexity were reported on UTB180, UOT100, and VMAT.
Critical strengths
- The experimental results have advantages, with W2Track reaching 61.35 AUC on UTB180, reporting GPU speed of 210.52 FPS, CPU speed of 27.09 FPS, and model parameters of approximately 4.87M. In the lightweight model group in Table 1, the accuracy on all three datasets is superior.
- The ablation coverage is relatively comprehensive. The author compared the independent combinations, different attention modes, skip layer positions, and threshold strategies of SAI and ALE, and provided density and difficulty analysis. These experiments provide a foundation for evaluating various designs, rather than just comparing the final results with external methods.
Critical weaknesses
-
The explanation of core attention design contradicts the actual information flow, and the definition of ALE execution is incomplete, resulting in insufficient evidence of the mechanism and innovation. The author claims that deleting $Q_st ^ \ top $can prevent information pollution templates in the search area. But according to standard attention calculation, the template output is weighted by $Q_tK_s ^ \ top $on the search value $V_s $, and the search output is weighted by $Q_SK_t ^ \ top $on the template value $V_t $. Therefore, equation (3) actually preserves the path for search information to enter the template, while deleting the path for template information to enter the search feature. This contradiction directly relates to the core motivation of SAI and cannot be resolved solely by renaming the interaction direction; We need to explain why the reserved path can suppress the interference mentioned. ALE performs skip layers on consecutive candidate layers, but equation (13) relies on the previous layer's attention $A_ {i-1} $. How to obtain attention when the current layer is skipped? The weighted output description of equation (12) itself cannot prove that block calculations are truly omitted during inference, and it is necessary to clarify the actual condition branches and their timing ranges. In addition, the regularization term $L_ {\ mathrm {reg}} $only references AVTrack and does not provide the actual formula and hyperparameters used. In addition, this article has cited works such as FERMT (ECCV 2024) and AVTrack (ICML 2024), but lacks direct comparisons and comparisons between existing execution strategies and the proposed entropy threshold on the same backbone. The current results are not sufficient to clearly define the contribution of the new design.
-
Some experiments cannot correspond to the overall results, weakening the main performance conclusions. Table 3 reports SAI gains of 2.354 and 1.195 AUC points for dense and sparse subsets, respectively. If both constitute a complete partition of UTB180 and are weighted in a manner consistent with the overall result, the total gain should be between these two numbers. Is it a specially selected subset? Therefore, this analysis currently cannot reliably support the conclusion that 'SAI is more effective for dense targets'. Table 4 also lacks difficulty grouping criteria and sample size. On page 6, the method is classified as non real time according to "over 20 GMACs", but in Table 1, multiple methods in this group still significantly exceed 30 FPS on the same GPU. For example, PUTrack is 60.15 FPS and UTB180 AUC is higher than W2Track; AQATrack reaches 133.59 FPS. Therefore, if GPU 30 FPS is used as a criterion, the statement 'better than existing real-time trackers' is not valid. For dynamic models, it is also necessary to explain how individual GMACs values are calculated, and whether the speed includes attention entropy, routing judgment, pruning, and post-processing is also not specified. The average speed on RTX 5090 can support desktop GPU efficiency, but it is not sufficient to directly demonstrate the deployment performance of resource constrained underwater platforms.
Questions for authors
-
Please specify which branch to update for each cross frame path in equation (3). Since \ (Q_tK_s ^ \ top V_s ) is still writing search information into the template, how can deleting \ (Q_stK_t ^ \ top ) achieve the claimed template interference suppression? Is this a textual error or is the formula/implementation different from the description?
-
How to obtain the attention entropy of equation (13) when continuously jumping layers? Please provide the pseudocode for inference, the masking method for prohibited attention blocks, and the actual use of \ (L_ {\ mathrm {reg}} ) and hyperparameters. Does the attention module truly omit matrix calculations instead of calculating the complete matrix and then masking it?
-
Which model configuration in Table 2 does Table 3 correspond to? Does Dense/Sparse cover all UTB180 sequences? Please provide the number of sequences, grouping criteria, and overall indicator aggregation method, and explain the difference between subset gain and overall gain. How to determine the difficulty of Table 4?
-
Why wasn't FERMT compared? What is the independent benefit of the proposed entropy threshold relative to the AVTrack fixed threshold under the same backbone, training data, and execution budget? Are the layer positions and thresholds selected through independent validation sets?
-
Which dataset and execution rate does 1.553 GMACs correspond to? What batch size, numerical accuracy, synchronization and preheating settings are used for FPS testing, and what steps are included in timing? Please specify 20 GMACs as the basis for real-time grouping boundaries.