- Rating
- 3
- Confidence
- 2(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes OmniGlimpse, an online multi-view tracking framework that separates adaptive association from stable identity verification. It employs target-specific adapters for online adaptation and long-term Gaussian identity distributions for verification. A verification-gated update mechanism is introduced to reduce identity drift. Experiments on M3Track and MvMHAT demonstrate improvements in identity maintenance and cross-view association.
Critical strengths
- The paper addresses an important challenge in online multi-view tracking by balancing adaptive representation learning with stable identity verification.
- The proposed framework achieves substantial improvements over the evaluated online baselines, with ablation studies supporting the effectiveness of its key components.
Critical weaknesses
- The experimental setting is relatively restricted, as each target is initialized in every camera view and only two designated targets are evaluated per scene. Moreover, the online baselines do not utilize cross-view information, which limits the fairness of the comparisons.
- The methodological novelty and necessity of the asymmetric dual-space design require further justification. Although the ablation studies demonstrate performance improvements, they do not fully establish its advantages over simpler alternative designs.
Questions for authors
- The evaluation assumes that each target is initialized in every camera view, with only two designated targets per scene. How well does the proposed framework generalize to scenarios with incomplete cross-view initialization or a larger number of targets?
- The online baselines operate independently across camera views, whereas OmniGlimpse utilizes cross-view information. Could the authors provide comparisons under more consistent cross-view information settings to better demonstrate the advantages of the proposed framework?
- The Adaptive Query ablation modifies only the verification query while retaining canonical Gaussian statistics. Could the authors further compare the proposed dual-space design with a unified adaptive feature space to better justify its necessity?
- Although the proposed method improves IDF1 and CVIDF1, Tables 1 and 2 show more identity switches than OCLReID. Could the authors further explain this observation and analyze its implications for long-term identity stability?
3 comments
Thank you for your response. While I consider this a solid piece of work, the novelty does not particularly impress me. Therefore, I have decided to maintain my current score while increasing my confidence rating.
Thank you for reading our response and considering the additional results. We appreciate your positive assessment and your comments, which have helped us further improve the paper. Thank you again for the time and attention you have given throughout the discussion.
We appreciate your positive assessment of the identity-memory design and your questions about its scope and supporting evidence. We have expanded the evaluation and clarified initialization and verification. Revisions are marked in blue.
Q1. Initialization setting and scalability to more targets. Related initialization protocols appear in prior work: Beyond SOT specifies multiple targets through initial bounding boxes [1], OCLReID adapts online to a designated person [2], and Multi-Drone-Based Single Object Tracking initializes the same target in each drone view before sharing target templates [3].
In OmniGlimpse, the initialization box at each target's first appearance in each view provides the only ground-truth identity supervision. Large viewpoint differences can make the same target look substantially different across cameras. Without local initialization, identity matching must rely on another view's appearance before a reliable local reference exists; an incorrect match can contaminate persistent memory and be reinforced by online updates. We therefore use one initialization per target per view as the minimal starting condition for our identity-memory and adaptation mechanism. No further identity annotation, scene-specific offline training, camera calibration, or geometric priors are required.
We also evaluated 2, 4, and 6 designated targets on the same eight M3Track scenes containing at least six valid targets. Comparing two with six targets, CVIDF1 remains comparable (54.52 vs. 54.60), as does MOTP (78.45 vs. 78.12). HOTA decreases from 58.36 to 52.53 and IDF1 from 77.11 to 69.65, but both change by less than 0.5 points from four to six targets. These results support tracking more designated identities while preserving comparable CVIDF1 and MOTP, with HOTA and IDF1 stabilizing at the higher target counts (Table 4, Section 4.4).
Q2. Cross-view baseline comparison. We added OCLReID+CV, which augments the original OCLReID pipeline [2] with target-specific cross-view memory, and the native multi-camera baseline OpenVINO MCMT [4]. The original view-independent online baselines also receive cross-camera target correspondence through aligned initialization labels, providing a favorable starting condition.
Cross-view memory improves OCLReID, but OmniGlimpse retains a clear performance advantage. Its IDF1 gains over OCLReID+CV are 6.03 points on M3Track and 17.38 points on MvMHAT, with corresponding CVIDF1 gains of 14.56 and 24.06 points. OpenVINO MCMT also performs substantially below OmniGlimpse on both datasets. Tables 1–2 contain the results, and Appendix B.2 describes the implementations.
Q3. Unified adaptive feature space. To address the potential query–memory mismatch in Adaptive Query, we added Unified Adaptive Space, using adaptive features for both verification queries and Gaussian memory. This variant improves CVIDF1 from 59.60 to 59.84 and reduces IDs from 44 to 41.
The full model further raises CVIDF1 to 61.29 and MDA from 53.58 to 55.03, while reducing IDs to 28. This comparison supports separating adaptive association from persistent verification: the adaptive representation accommodates current appearance changes, while the canonical representation keeps accumulated identity evidence in a fixed space. Table 3 and Section 4.3 report the comparison, with implementation details in Appendix B.3.
Q4. Identity switches and long-term identity stability. We expanded the analysis to examine target coverage, incorrect associations, error duration, and switch conditions (Tables 9–10, Appendix B.5). Relative to OCLReID, OmniGlimpse improves target recall from 61.27% to 70.83% on M3Track and from 37.75% to 61.93% on MvMHAT. It also substantially shortens incorrect-association segments, reducing their median duration from 8 to 3 frames and from 24 to 6 frames, respectively. These gains are accompanied by higher wrong-association rates (9.35% vs. 3.88% on M3Track and 9.38% vs. 7.00% on MvMHAT).
Occlusion or person overlap accounts for 57.1% of OmniGlimpse's switches on M3Track and 50.0% on MvMHAT, with most remaining switches associated with re-entry or small targets. After bootstrapping, observations that fail verification cannot update persistent Gaussian memory or supervise online adaptation, so a current association error does not automatically enter the persistent identity state.
References.
[1] Mayer et al. (2024). Beyond SOT: Tracking Multiple Generic Objects at Once. WACV.
[2] Ye et al. (2024). Person Re-Identification for Robot Person Following With Online Continual Learning. IEEE Robotics and Automation Letters.
[3] Zhu et al. (2020). Multi-Drone-Based Single Object Tracking With Agent Sharing Network. IEEE Transactions on Circuits and Systems for Video Technology.
[4] OpenVINO Toolkit. Open Model Zoo: Multi-Camera Multi-Target Tracking Python Demo.