- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes RIMTracking, an RGB-T multi-object tracking framework designed to improve identity consistency and tiny-object tracking. The framework builds on MOTIP for identity prediction and MS-DETR for multimodal feature extraction. It introduces two components: Observation-Filtered Identity Memory (OFIM), which maintains trajectory-level memory and selectively updates it according to observation and association confidence, and Scale-Adaptive Cross-Modal Detail Refinement (SCDR), which incorporates high-resolution RGB-T features into object queries with scale-dependent weighting.
Critical strengths
-
Strong empirical performance on relevant RGB-T tracking benchmarks: The proposed framework achieves substantial improvements over the reported baselines on VT-Tiny-MOT and VT-MOT. The gains in HOTA and IDF1 suggest that integrating improved multimodal observations with persistent identity memory can be effective for challenging tracking scenarios
-
A practically motivated approach to identity memory management: Separating the use of current observations for identity prediction from their incorporation into persistent memory is a sensible design.
Critical weaknesses
-
The main technical components are closely related to prior work. MeMOTR [1] has already explored EMA-based long-term trajectory memory and memory injection, while SambaMOTR [2] explicitly prevents uncertain observations from contaminating temporal memory through MaskObs. MOTIP [3] provides the ID prediction framework adopted by this paper. Similarly, SCDR combines established ideas from deformable attention, high-resolution feature retrieval, and scale-dependent feature refinement. Although adapting these mechanisms to RGB-T identity prediction may be useful, the paper does not sufficiently demonstrate what fundamental methodological advance is introduced beyond their combination.
-
The reported improvements from the proposed modules are considerably smaller than the overall gains over earlier trackers. On VT-Tiny-MOT, adding both modules improves HOTA from 34.980 to 35.908. Moreover, the full OFIM write policy improves IDF1 by only 0.055 points over detection filtering with a cooldown interval, suggesting that much of the benefit may arise from a comparatively simple update-frequency heuristic. The component ablation also lacks an OFIM-only configuration, making it difficult to assess the independent contributions and interaction of the two modules.
[1] Gao, Ruopeng, and Limin Wang. "MeMOTR: Long-term memory-augmented transformer for multi-object tracking." 2023 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2023.
[2] Segu, Mattia, et al. "Samba: Synchronized set-of-sequences modeling for multiple object tracking." International Conference on Learning Representations. Vol. 2025. 2025.
[3] Gao, Ruopeng, Ji Qi, and Limin Wang. "Multiple object tracking as id prediction." 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2025.
Questions for authors
-
What is the essential technical difference between OFIM and existing memory mechanisms such as MeMOTR and SambaMOTR's MaskObs? Can the authors provide a controlled comparison with these alternative memory-update strategies using a common tracking backbone?
-
Can the authors disentangle the contributions of persistent memory reading, unfiltered EMA updating, cooldown-based filtering, and the complete OFIM write policy? In particular, why does detection-plus-identity filtering perform worse than detection-only filtering?