- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors identify temporal state misalignment as a potential issue in query-propagation-based multi-object tracking methods such as MOTR, where track queries inherited from previous frames may no longer accurately represent targets in the current frame, particularly under significant object or camera motion.
To address this issue, the authors propose a lightweight pre-alignment module, termed the Motion-Aware Transformer (MAT), which leverages current-frame observations to update both the feature representations and spatial references of inherited track queries before joint decoding. Built upon MOTR, the proposed MATR framework achieves substantial improvements in tracking performance.
Critical strengths
The authors provide a reasonable analysis of the limitations of track-query propagation in MOTR-style trackers. The proposed pre-alignment module is also intuitive and conceptually simple, offering a straightforward way to mitigate temporal state misalignment.
Critical weaknesses
-
The authors use different evaluation splits across their ablation studies, which is inconsistent with standard experimental practice and makes the results difficult to compare systematically. The explanation provided in Lines 361–362 is not sufficiently convincing, as the absence of a reported MOTR validation result does not prevent the authors from evaluating the MOTR checkpoint on the validation set. The authors should adopt a consistent evaluation protocol across their ablation studies to ensure clearer and more rigorous comparisons.
-
Table 3(b) lacks a corresponding baseline without MAT (i.e., Bl-IMP evaluated on the same validation split). Without this baseline, it is difficult to assess the individual contributions of feature and position alignment relative to the original configuration, or even determine whether each component provides a positive improvement.
-
The effectiveness of spatial alignment is not sufficiently demonstrated in Table 3(b). Specifically, combining feature and position alignment improves HOTA by only 0.2 points compared with feature alignment alone (58.1 vs. 57.9). Such a marginal improvement could potentially result from random fluctuations during end-to-end MOT training. The authors should provide additional ablation results to establish the robustness of this improvement. Furthermore, it is unclear whether the auxiliary L1 alignment loss (Eq. (5)) is retained when position alignment is disabled in the Feature-only configuration. This implementation detail should be clarified.
Questions for authors
In the Weaknesses section, we have raised three key concerns and questions that require direct, point-by-point responses from the authors. We consider these to be substantive, fact-based issues concerning the paper's methodology and experimental evidence, rather than matters of subjective interpretation or preference. If the authors satisfactorily address these concerns, and no other reviewers raise additional issues that I consider fundamental or potentially fatal to the paper, I would be willing to raise my score.
Beyond the issues discussed above, we would also like the authors to clarify how MAT handles inherited track queries whose corresponding targets are absent from the current frame. Specifically, are the pre-aligned states retained or discarded, and can they affect the states propagated to subsequent frames? Does the handling of such queries differ between training and inference?
We also encourage the authors to improve the visual presentation of Fig. 2 to make it more polished and publication-ready. Specifically, some modules and graphical elements appear misaligned, and the visual balance between different shapes (e.g., squares and triangles) could be improved. More consistent alignment, spacing, and visual centering would enhance the overall clarity and professionalism of the figure.
Dear Reviewer,
Thank you again for your valuable feedback. We have provided a detailed response to your concerns and would greatly appreciate it if you could take a look when you have a chance.
We would be grateful to know whether our clarifications have adequately addressed your main concerns, or if there are any remaining questions that we could further clarify during the discussion period.
Thank you for your time and consideration.