- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies motion-centric single object tracking task on LiDAR pointclouds. The porposed method, MOPRU, combines the standard relative motion prediction and recurrent long-term motion modeling via a learnable gating mechanism. Experiments demonstrate MOPRU achieve state-of-the-arts performance on KITTI, NuScene and Waymo.
Critical strengths
- The distinction between a correction that gives a good current box and one that leaves a useful recurrent state is meaningful and novel.
- The short closed-loop horizon used in training can help the model learn from its consequences, alleviating the accumulated errors.
Critical weaknesses
- The mean improvements seem to be minor, especially on NuScenes and Waymo
- Figure 2 and Figure 3 are hard to follow. It is better to add more detailed description in the captions.
- The effect of the motion-state update in Equation(4) is not studied in the ablation experiments.
Questions for authors
- Is the model’s performance sensitive to the category-specific bounds ? How to set these bounds?
- How does the proposed supervision compare with a matched multi-frame unrolled training objective, and what happens when training history is longer than five frames?
Clarifications on Recurrent Motion-State Updates, Supervision, and Experimental Analysis
We thank the reviewer for the constructive feedback. We have added fixed-parameter interventions (Table 6) and a comparison of motion update supervision objectives (Table 7) to the main text (p. 10), revised the captions of Figures 2 and 3 (pp. 3–4), and added sensitivity analyses of training clip length and motion clipping bounds (Tables A24–A25, Appendix H). We address the concerns below.
W1: NuScenes and Waymo improvements.
On NuScenes (Table 2), MoPRU improves SiamMo by +2.62/+2.98 Success/Precision points, reaching 62.93/75.66 and surpassing TrajTrack (62.25/75.15). On zero-shot KITTI-to-Waymo transfer (Table 3), it improves SiamMo by +2.8/+4.7 points over 427,483 frames, with +6.0/+7.3 on hard Pedestrian. MoPRU achieves the highest reported Vehicle/Pedestrian mean scores on Waymo.
W2: Figures 2 and 3.
We have revised both captions (pp. 3–4), with the changes highlighted in blue in the manuscript. Figure 2 presents MoPRU's unified learning of motion prediction and recurrent motion-state update. Shared update weights are learned from differences in short-horizon tracking outcomes to guide current RTM refinement and recurrent motion-state update for subsequent motion prediction. Figure 3 clarifies that four branches differ only in the current update, then evolve separately to construct training supervision. These branches are not used at inference.
W3: Recurrent motion state update (Eq. 4).
Equation (4) combines the pairwise motion feature and motion cues into the state-update input using the same weights as RTM refinement. With model parameters and current target boxes fixed, Table 6 reports next motion prior displacement/heading errors of 0.260 m/3.22° (learned), 0.273 m/3.38° (zero input), and 0.281 m/3.49° (no update). Under refined RTM, the corresponding H=2 tracking errors are 0.780/0.802/0.816; under pairwise RTM, learned and zero input updates both yield 0.835. Recurrent-state updates affect subsequent localization through motion-prior-guided RTM refinement (Eqs. 3–5).
Q1: Motion clipping bounds.
Equation (3) bounds the correction toward the motion prior by (1−αtj)cj, with category-specific bounds reported in Table A4. Table A25 uniformly scales these bounds while keeping other settings, including H=2, unchanged.
Sensitivity to motion clipping bounds on KITTI (Table A25, Appendix H). Success/Precision (%).
The default clipping bounds achieve the highest Success/Precision, while both tighter and looser bounds reduce performance, indicating the importance of an appropriate correction range for motion-prior-guided RTM refinement.
Q2: Motion update supervision.
Table 7 compares objectives under the same shared motion update structure.
Comparison of motion update supervision on KITTI (Table 7, p. 10). Success/Precision (%).
At H=2, outcome differences outperform multi-frame unrolling and direct future error supervision. The four updates share the initial box and recurrent state, but evolve separate tracking rollouts after the current update (Sec. 3.3). Future observations are used only to construct training targets.
Training history and supervision horizon.
Training uses five-frame clips, resetting the recurrent state per clip; inference propagates it over the full tracklet (Sec. 4.1; Appendix A). The supervision horizon H=2 covers two subsequent tracking frames. Table A24 varies clip length with the same supervision horizon and motion-update formulation.
Sensitivity to training clip length on KITTI (Table A24, Appendix H). Success/Precision (%).
Increasing clip length beyond five frames does not improve tracking performance.