- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
TrackEVT addresses cases where a robot tracks a region confidently but follows the wrong instance. A propagated pixel mask drives control, while stored target and distractor trajectories check identity. Before correcting the tracker, the system verifies a target mask in the current frame and then reinitializes propagation. The evaluation covers three simulation benchmarks, a same-clothing distractor test and a real robot, without task-specific training.
Critical strengths
- Checking target identity while the tracker remains confident is a useful idea. Separating control from identity memory gives the system a way to correct persistent tracking of the wrong person.
- The experiments cover people, vehicles, simulation and a real robot. The Cutie-safe comparison and fixed-step rerun are useful controls and make the reported improvements more convincing (Tables 5 and 9).
Critical weaknesses
- Table 5 provides useful evidence for rebinding. I would still like to know how reliably the audits detect identity errors while pixel confidence remains high. The paper does not report how many such errors are caught, or how often an accepted correction selects the wrong instance. These measurements would directly support the claimed benefit of identity auditing and verified rebinding.
- The smaller ablation gains need uncertainty estimates. On Cross-ID, the full method succeeds in seven more episodes than Cutie-safe: 66/90 versus 59/90. Paired results on the same seeds would help judge how consistent this gain is. The calculation of the confidence intervals in Table 7 is also unspecified.
Questions for authors
- How many identity errors do the audits detect while pixel confidence remains high? Among accepted corrections, how many recover the original target and how many select a distractor?
- Could you provide paired per-seed results for Tables 5 and 9 and explain how the confidence intervals in Table 7 were calculated? For Crossing IDSW and PN-Rec@30, could you provide uncertainty estimates that account for repeated crossings within the same episode? If the additional results show that the audits make reliable corrections and the gains hold in the paired analysis, I would raise my rating from 2 to 3.