- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes SPOT, a sequence-level post-training framework for visual tracking. It treats native localization outputs as stochastic policies and samples tracking trajectories using prediction-driven search crops. Training combines trajectory-level IoU returns, group-relative advantages, batch-global normalization, and KL regularization against a frozen reference tracker. Only localization-related parameters are updated, leaving the architecture and test-time procedure unchanged. Experiments on OSTrack, ARTrackV2, and MCITrack show consistent improvements across four benchmarks.
Critical strengths
- SPOT addresses the mismatch between supervised training and prediction-driven tracking, where localization errors affect subsequent search regions. It improves existing trackers without changing their test-time procedures or adding sampling and post-processing at inference. This makes the approach practical to adopt.
- The evaluation covers one-stream, autoregressive, and memory-based trackers, with improvements across all four benchmarks. The controlled SCST comparison and the ablations on crop transitions and trainable parameters provide useful evidence beyond the main benchmark results.
Critical weaknesses
- Limited novelty over prior work. SLT already uses prediction-driven rollouts and trajectory-level rewards. SPOT mainly introduces group-relative advantages, global normalization, and reference KL. However, the SCST comparison changes all these components together, making it difficult to identify where the improvement comes from. A comparison with SCST using the same KL and normalization would be helpful.
- Lack of a supervised fine-tuning baseline. The paper does not compare SPOT with continued supervised fine-tuning under the same training budget. In particular, an SFT baseline using prediction-driven crops would help clarify whether the improvements come from state-distribution alignment or the proposed sequence-level optimization.
- Insufficient analysis of long-term tracking. Although reducing error accumulation is a key motivation, SPOT only trains on short trajectories (8–12 frames). The cumulative-prefix AUC results in Figure 3 do not directly show reduced tracking drift. A more direct analysis of tracking failures or error accumulation would strengthen this claim.
Questions for authors
- Does SPOT still outperform SCST when both use the same KL regularization and advantage normalization?
- How does SPOT compare with continued supervised fine-tuning using the same checkpoint, data, trainable parameters, and training budget? A version using prediction-driven crops would help separate the benefit of state-distribution alignment from that of the trajectory-level objective.
- Can the authors provide more direct evidence that SPOT reduces long-term tracking drift?