- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies temporal stability in online vectorized HD mapping, focusing on how different historical memories within the same tracked instance are used. The proposed STEM framework introduces Triple Correlation Aggregation (TCA) into a MapTracker-style temporal mapping pipeline. TCA sums content similarity, low-dimensional matching similarity, and geometric-temporal context similarity into a signed score. It selects Top-K memories by score magnitude, aggregates them through separate branches according to score polarity, and produces a residual update through query-conditioned gating. During training, Trackwise Contrastive Regularization (TCR) constrains selected same-track positive pairs and separates hard cross-track negatives in a shared projection space. TCR is removed at inference. The paper reports improvements in accuracy and stability on nuScenes and Argoverse 2. It includes correlation-factor and loss ablations, sensitivity analyses for K and the negative-mining threshold, polarity-usage statistics, and a 2-by-2 retrieval-by-aggregation ablation in the appendix. The work has clear practical value, and the distinction between memory retrieval and integration is worth investigating. The main concerns are the internal consistency of the central stability results and whether the proposed mechanism's benefits have been sufficiently separated from auxiliary training and branch capacity.
Critical strengths
S1. The problem is specific, and the evaluation metrics match the objective. The paper evaluates Presence, Localization, Shape, and mAS alongside single-frame mAP. Query-conditioned selection among historical entries in persistent memory is a natural and useful direction for tracking-based mapping. Its value does not depend on claiming comprehensive leaderboard dominance. S2. The central design is supported by direct controlled comparisons. Appendix A.2 and Table 11 report four separately trained combinations of magnitude-based retrieval and polarity-aware aggregation, providing stronger evidence than an ablation that only adds the entire module. With polarity-aware aggregation fixed, magnitude-based retrieval improves mAP/mAS by 0.43/0.80 points. With magnitude-based retrieval fixed, polarity-aware aggregation improves them by 0.52/0.98 points. These results provide substantive support for the main design. S3. The main nuScenes results are encouraging. Relative to the baseline in Table 3, the full method improves mAP/mAS from 72.93/84.57 to 75.00/88.41, corresponding to gains of 2.07/3.84 points. TCA alone also improves mAP/mAS by 0.59/1.59 points, indicating that the inference-time operator's benefit does not depend entirely on TCR. The single-factor and leave-one-out ablations in Table 4 provide additional evidence that the three correlation sources may be complementary. S4. The scope of the methodological and theoretical claims is generally appropriately qualified. The authors explicitly state that score polarity is a learned relation rather than a ground-truth semantic label. The appendix proposition is restricted to an operator-level property with fixed value features and does not claim that the complete model is universally more expressive than attention. These qualifications are appropriate. S5. The deployment cost is attractive. TCR is used only during training. Table 6 reports similar latency for the two methods on the same RTX 4090, supporting comparable inference efficiency. This is practically relevant for continuously operating perception modules. The multi-frame overlays in Figure 4 also show cleaner and more continuous local geometry, although they primarily provide qualitative support.
Critical weaknesses
W1. The central Argoverse 2 mAS result has a verifiable inconsistency with the stated formula and requires priority clarification. Page 7 defines the stability of each matched instance as: $ s_e=p_e\bigl(0.7l_e+0.3h_e\bigr),\qquad 0\le p_e,l_e,h_e\le1.$ If Loc, Shape, and mAS in Table 2 use the same instance sets and the same within-class and across-class averaging, then necessarily The STEM row in Table 2 reports Loc=88.48 and Shape=98.01, yielding an upper bound of 91.339. However, the reported mAS is 93.25, exceeding this bound by 1.911 percentage points. This discrepancy is substantially larger than two-decimal rounding can explain. This argument does not multiply marginal means; it uses a necessary condition obtained by applying the same order-preserving averaging operator to an instance-wise inequality. If the component metrics and mAS use different valid samples, class weights, or matching filters, the authors should specify those conventions and explain their consistency with the stated definition. A table error or an implementation/configuration error is also possible. Until clarified, the claimed 2.98-point mAS improvement on Argoverse 2 cannot serve as reliable evidence for acceptance. This issue does not establish research misconduct or directly demonstrate that TCA is ineffective; it undermines the reliability of a central reported result.
W2. The provenance of the baselines and the experimental settings are insufficiently documented to establish fully fair comparisons. On nuScenes, MapTracker achieves 73.26 mAP in Table 1 but 72.93 in Tables 3 and 6, with noticeably different category-level AP values. The 2.07-point gain stated in the contribution summary corresponds to the latter baseline; the gain relative to Table 1 is 1.74 points. These results could reasonably come from published results and the authors' reproduction, respectively, but this distinction should be explicitly labeled. Both baselines also have exactly the same reported mAS of 84.57, warranting clarification of their evaluation provenance. Table 1 states only that methods are compared under their reported training settings. It does not individually specify the backbone, image resolution, perception range, original versus geographically disjoint split, annotation processing, or training budget. Geographic leakage in online mapping has been explicitly documented, making the split a substantive evaluation choice rather than a minor implementation detail. Lilja PredMapNet, published at WACV 2026, is another closely related method that the paper cites but does not compare quantitatively. Its published numbers alone do not establish that STEM is worse under a fair comparison. Nevertheless, the authors should explain its omission and position their conclusions under comparable configurations.
W3. Table 11 supports the design's effectiveness but does not fully isolate the contribution of the polarity mechanism. The two branches have independent projections and and query-conditioned gating. However, the exact formula, parameter count, and training-time TCR positive-sampling rule for the Unified variant are not provided. The comparison may therefore combine differences in branch partitioning, projection capacity, gating, and regularization sampling. Stating that all other configurations are fixed is insufficient to establish that these factors are controlled. Furthermore, the independent projection has no sign constraint. Defining absorbs the negative branch's explicit subtraction into its projection. Thus, score polarity does determine branch routing, but the output minus sign alone does not guarantee semantic cancellation of erroneous history. The appendix's appropriately qualified fixed-value convex-hull result does not establish that explicit subtraction is indispensable in the complete network. A capacity-matched two-branch control, or a narrower mechanistic interpretation, would address this concern. TCR also contributes substantially: in Table 3, adding it to TCA improves mAP/mAS by 1.48/2.25 points, exceeding the gains from TCA alone. Since temporal instance contrastive learning has precedents, a conventional trackwise contrastive regularizer that approximately matches the projection space and sampling budget while remaining independent of TCA scores would help establish TCR's specific value.
Questions for authors
Refer to Weaknesses
4 comments
Thank you for your answer, this will help me improve my rating. As I mentioned earlier, it has been clearly documented that the online maps in nuScenes and Argoverse 2 have geolocation leakage issues. Therefore, even if this paper is ultimately accepted, I strongly recommend that you include experimental results on nuS and AV2 from the “new split”; this will contribute to the community's progress. You can refer to: https://arxiv.org/pdf/2610.01905, https://ieeexplore.ieee.org/abstract/document/10658066.
Thanks for your timely information.
Thanks for your following up. We will share the result here and update this result in paper once they are available. Based on the current status of the GPU, we should be able to complete the two sets of experiments for MapTracker and STEM on the new split by the 16th.
Thank you to the authors for the further clarification. I would like to add one more point: I believe the authors' current experiments and analysis are already quite sufficient, and the experiments on the new split are merely suggested as an extension. I look forward to the authors completing these experiments to further strengthen the persuasiveness of the work. I also look forward to the authors' future work.
Response to Reviewer jfYG: W1, W2
Thank you for the detailed review. We clarify the Argoverse 2 stability calculation, reconcile the MapTracker baseline across the nuScenes tables, and explain what the aggregation ablations and the two new controls test.
W1. Argoverse 2 mAS: Localization Weight and Evaluation Protocol
We apologize for the incorrect weight stated in the manuscript. It‘s a typo error. We used a localization weight of 0.5 in the Argoverse 2 evaluation and have corrected the manuscript accordingly.
Matching and averaging. We match predictions to ground truth within each frame and pair observations across frames by ground-truth instance ID. For each run, Presence, Loc, Shape, and SI use the same retained pairs, excluding pairs missed in both frames. Each class mean uses the retained pair count shown below. SI applies Presence to the equally weighted Loc and Shape for each pair before averaging. Each reported mean weights the classes equally.
The table gives the class SI and valid pair counts for STEM and MapTracker in Table 2.
On Argoverse 2, STEM achieves 93.25 mAS, an improvement of 2.98 points over MapTracker (90.27 mAS).
W2. MapTracker Baseline and Comparison Protocol
On nuScenes, the 72.93 mAP entry in the original Tables 3 and 6 was the MapTracker result reported in the AMap paper, whereas 73.26 mAP in Table 1 came from our MapTracker reproduction. The 84.57 mAS was computed using our reproduced model. We have unified the reporting around this reproduction and updated the corresponding mAP gain to +1.74.
The compared methods use ResNet-50, the same input resolution and perception range, and consistent dataset splits and annotation processing, while retaining their method-specific training schedules. Our comparison evaluates temporal mapping under the common original scene-based split.
PredMapNet is discussed in Related Work, but its implementation is not publicly available for a same-protocol reproduction. Its rasterized map history and future guidance also differ from STEM’s query-conditioned selection and integration of individual same-track vector memories.