- Rating
- 4
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This manuscript addresses long-term RGB-Event single object tracking, a problem that has not been systematically evaluated in existing benchmarks. The topic is well motivated, and the amount of work is substantial.
Critical strengths
1.Solid dataset and benchmark contribution. The authors construct FELT, a relatively large-scale long-term RGB-Event tracking dataset, which is meaningful. 2.The method is reasonably connected to the long-term tracking setting. This design of AMTTrack is relevant to several key issues in long-term tracking, such as appearance variation, use of historical information, and template maintenance. The experimental results also show performance gains. 3. The manuscript is well-structured and clearly written, making it easy to follow.
Critical weaknesses
-
In AMAH, features from preceding layers are used as stored patterns, and later-layer features are used for retrieval. The design itself is reasonable, but the motivation for the selected layer combination and memory bank construction is not fully discussed. The authors may explain why the current layers are chosen and what role shallow or intermediate features play in RGB-Event tracking.
-
The notation and description of the Hopfield layer could be made more consistent. Both AMAH and ATU use Hopfield layers, but their input meanings and memory sources are different: AMAH is mainly used for cross-layer and cross-modal retrieval, while ATU is used for dynamic template enhancement. The authors should more clearly distinguish the inputs, outputs, and roles of these two modules.
Questions for authors
1.FELT includes long-term tracking attributes such as out-of-view and full occlusion, but the annotation and evaluation rules for these frames are not fully clear. For example, it is not explicitly stated whether bounding boxes are provided when the target is completely invisible, whether such frames are included in SR/PR/NPR computation, and how predictions are judged in absent frames. I suggest the authors clarify these details.
Response to Reviewer bhn3
We thank the reviewer for the positive assessment and constructive suggestions. We address each point below.
W1: Motivation of the layer combination and memory bank construction in AMAH.
The design follows the complementary roles of shallow and deep features in RGB-Event tracking. Shallow and middle blocks preserve high-frequency structural cues, especially the edges and motion contours captured by event streams, while deep blocks encode semantic identity that remains stable under appearance changes. AMAH therefore uses the features of preceding layers as the Hopfield memory bank for later-layer retrieval: the search-region features at layers 5 / 8 / 11 retrieve against the search-region features of layers {1, 3} / {4, 6} / {7, 9}, so that each retrieval layer recalls patterns of a comparable abstraction level, and the pairing deepens progressively with network depth. Moreover, the retrieval is performed cross-modally (RGB search features retrieve event-side patterns and vice versa), injecting complementary modality evidence at every depth rather than only at fusion. We will add this motivation discussion to the revision.
W2: Notation consistency of the Hopfield layers in AMAH and ATU.
We agree and will fix this in the revision. Specifically, we will (i) unify the notation of the Hopfield retrieval layer across both modules, and (ii) add a comparison table that explicitly distinguishes their inputs, outputs, and memory sources:
Q1: Annotation and evaluation rules for out-of-view / fully occluded frames.
We clarify the rules defined in our benchmark. (1) When the target is completely invisible (out of view or fully occluded), the ground-truth annotation marks the frame as absent with a non-positive bounding box (width or height ≤0); we additionally provide a frame-level absence flag file for each sequence. (2) SR / PR / NPR are the three widely used tracking metrics, computed under the standard one-pass evaluation (OPE) protocol as in recent tracking benchmarks (e.g., LaSOT, VisEvent, COESOT): SR is the area under the success curve (overlap thresholds from 0 to 1), PR is the percentage of frames whose center error is below 20 pixels, and NPR is the normalized precision, where the center error is normalized by the target size and reported at a threshold of 0.2. All metrics are computed over entire sequences: absent frames are excluded from the scoring yet remain in the denominator, so they always count as failures, and a tracker is continuously penalized until it re-acquires the target; predictions in absent frames cannot accidentally score, and the re-acquisition speed directly affects the final metrics. We will also release the frame-level absence annotations together with the dataset.