- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes AlignTrack, a lightweight vision-language-action framework for embodied visual tracking. It introduces a semantic-aligned depth encoder and an action-relevant understanding decoder, together with a two-stage training strategy that first aligns depth features with pretrained RGB representations and then jointly optimizes spatial understanding and action prediction. The proposed 0.6B model achieves competitive results against the 7B TrackVLA on EVT-Benchmark.
Critical strengths
-
The paper addresses an important problem of explicitly connecting semantic understanding, geometric perception, and action generation in embodied tracking.
-
The overall architecture is relatively lightweight and clearly structured, and the use of explicit target-state supervision is practically meaningful.
-
The improvements on the AT setting are substantial, particularly in tracking rate and collision rate.
Critical weaknesses
-
The main ablation only compares the full model with “w/o Depth” and “w/o Depth & Spatial Sup.” It therefore demonstrates the effect of adding depth, but does not establish whether the proposed semantic alignment pretraining is actually necessary. A direct comparison between aligned depth initialization and randomly initialized depth features is essential, especially since this control is mentioned in the appendix but no corresponding results are reported.
-
AlignTrack uses additional metric-depth observations as input and relies on two pretrained visual encoders, DINOv3 and SigLIP, while the main efficiency argument primarily emphasizes the 0.6B language backbone. End-to-end parameter count, FLOPs, memory consumption, and inference latency should be reported for a fair efficiency comparison.
The performance claims should be more carefully qualified. Although AlignTrack consistently improves tracking rate, it does not uniformly outperform TrackVLA. For example, on DT, AlignTrack obtains lower SR (53.70 vs. 57.6) and substantially higher CR (16.30 vs. 5.80). On STT, its SR is slightly lower and CR is also higher. The strongest overall advantage is mainly observed on AT. -
Bounding box, relative yaw, and visibility prediction are central to the proposed semantic–geometry–action coupling, yet the paper does not report the accuracy of these intermediate predictions. It is therefore unclear whether improved control truly results from better explicit spatial reasoning or simply from auxiliary supervision.
-
Compared with “w/o Depth,” the full model improves collision rate but decreases both SR and TR on DT and AT. For example, on AT, SR/TR decrease from 66.64/81.63 to 64.93/79.68. This behavior deserves further analysis rather than being summarized only as a complementary benefit.
-
Since the paper makes broader claims about lightweight embodied visual tracking and explicit spatial reasoning, evaluation in additional environments or under depth noise/domain shifts would provide stronger evidence of generalization.
Questions for authors
Please refer to Weaknesses.