- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes an interaction-aware neighbor representation for vehicle trajectory prediction. The method converts neighboring vehicles’ raw kinematic information into longitudinal and lateral interaction states, computes neighbor importance using a fixed exponential function, and refines these scores through driving-context-dependent slot weighting and top-n filtering. The resulting scores are incorporated as additional input features into several single-agent and multi-agent prediction models. The authors evaluate the method on highD and exiD through prediction benchmarks, ablation studies, and inference latency measurements on an embedded platform.
Critical strengths
The paper addresses a practically relevant problem. The representation of neighboring agents can affect trajectory prediction, and explicitly incorporating lane relationships and interaction priors has potential practical value.
The method is relatively simple and modular. The proposed importance features can be integrated into different prediction architectures through input adapters, and the authors evaluate multiple backbones.
The experiments include component analysis and efficiency evaluation. Beyond prediction accuracy, the paper reports ablations, results averaged over multiple random seeds, and forward-pass latency on an NVIDIA Jetson Orin Nano. Some model–dataset combinations show noticeable improvements.
Critical weaknesses
- The methodological novelty is limited, and comparisons with the closest prior work are insufficient.
The method primarily combines TTC-like measures, discrete interaction states, lane-slot semantics, and neighbor importance filtering. These ideas have been extensively studied in vehicle interaction modeling and trajectory prediction. Incorporating them as additional inputs into different backbones does not, by itself, establish substantial methodological novelty.
In particular, ASPILin (IROS 2025), which the authors already cite, also combines interacting-agent selection with physical correlation coefficients and evaluates its approach on datasets including highD. However, the paper provides neither a direct experimental comparison nor a sufficiently detailed analysis of the technical differences. Furthermore, SmartPretrain (ICLR 2025), also cited by the authors, explicitly proposes a model-agnostic representation learning framework. The characterization of existing representation methods as dependent on specific backbones therefore requires greater precision.
- The baselines are substantially outdated and do not adequately reflect the current state of the field.
CS-LSTM and SGAN were published in 2018, GRIP++ is cited as a 2020 method, and QCNet and MTP-GO were published in 2023. For an ICLR 2027 submission, even the most recent established baselines are four years old. The custom NeighFormer backbone cannot substitute for recognized recent strong methods.
These experiments demonstrate some architectural compatibility, but they do not establish whether the proposed handcrafted representation still provides consistent additional value when modern prediction models already have stronger interaction modeling capabilities. The authors should include recent strong models publicly available before submission, such as ModeSeq (CVPR 2025) and NDPNet (CVPR 2026), and compare their original versions against versions augmented with the proposed representation.
- The dataset coverage is insufficient to support the generalization claims.
The main experiments are restricted to highD and exiD, both highway datasets that closely match the method’s assumptions about relative lane relationships, surrounding slots, and lane-change contexts. The paper does not adequately explain why it omits evaluation on Argoverse, Argoverse 2, or the Waymo Open Motion Dataset.
AV2 and WOMD contain richer urban traffic and interaction scenarios, making them suitable for assessing applicability to complex road topologies and different types of traffic participants. WOMD also provides annotations and evaluation protocols specifically for interaction prediction. A single intersection example from inD in Figure 5 cannot replace comprehensive quantitative evaluation. The authors should evaluate on established urban driving benchmarks or explicitly restrict the scope of the method and its conclusions to highway vehicle prediction.
- The acquisition of driving context is unclear, raising a potential risk of future information leakage.
Appendix A.4 defines driving contexts using lane-following, lane-change direction, and pre-LC/post-LC categories, and states that contexts are assigned using the ego maneuver label and lane information. However, the paper does not explain how these labels are obtained using only observed history at test time, particularly how the future lane-change direction is determined before the maneuver occurs.
If test-time contexts are assigned from complete ground-truth trajectories, the augmented models may receive advance information about future maneuvers, compromising the validity of the comparisons. The current description is insufficient to conclude that leakage actually occurs, but this issue must be clarified. The authors should provide a context estimation procedure that uses only information available at prediction time, separately report results with ground-truth and predicted contexts, and ensure that the baselines receive the same legitimately available context information.
- Critical control experiments are missing, preventing clear attribution of the performance gains.
The full method introduces not only discrete interaction states but also lane semantics, maneuver context, and slot weights learned through an auxiliary trajectory prediction objective. Consequently, comparisons against a raw-kinematics baseline cannot determine whether the improvements arise from the proposed representation or from additional context and auxiliary supervision.
Under matched information and training budgets, the authors should compare against directly adding lane/slot features, continuous TTC or time-headway features, learned importance functions, and alternative neighbor ranking strategies. The finding that directly concatenating the two interaction states degrades performance is also insufficient to establish that the fixed exponential fusion is superior to a reasonably designed learned fusion mechanism.
- The results lack statistical uncertainty estimates, and the claims of overall effectiveness are stronger than the evidence supports.
Although the main experiments report averages over five runs, they provide neither standard deviations nor confidence intervals. Improvements are below 1% in several settings. For example, CS-LSTM improves ADE and FDE on exiD by only 0.11% and 0.04%, respectively, leaving their reliability unclear. MTP-GO instead shows worse minADE and minFDE on exiD.
The largest reported ADE reduction of 28.47% comes from a relatively weak GRIP++ setting, whose improved performance remains substantially worse than some other unmodified baselines in the same table. This maximum relative gain therefore does not adequately represent the method’s overall value for strong models. The authors should also report separate results for lane changes, merging, and dense interactions to verify that the gains actually arise from improved interaction modeling.
- The mathematical definitions are inconsistent with the claimed interaction semantics.
The authors state that longitudinal discretization preserves the sign distinguishing approaching from receding interactions. However, the zero-state interval in Table 5 is ([-3.1883,,2.2974)), which contains both negative and positive values and therefore cannot distinguish approaching from receding within this interval. Equation (3) subsequently uses (|\sigma_x|), assigning identical importance scores to corresponding positive and negative longitudinal states when the lateral state is unchanged.
The original kinematic inputs still contain directional information, but the added importance feature itself does not fully preserve the directional semantics emphasized by the authors. In addition, lateral states are determined using a fixed position threshold, without sufficient evaluation of early lane-change recognition, threshold sensitivity, or robustness to observation noise. These issues weaken the interpretability claims.
- The ablation conclusions and reproducibility details are insufficient.
In Table 3, using the importance score alone yields an ADE of 0.2394. Adding Slot or NF individually worsens ADE to 0.2496 and 0.2766, respectively, while adding both improves it to 0.2138. This suggests a possible interaction between the components, but does not establish that each component provides a stable contribution. Ablations across additional backbones, parameter sensitivity analysis, and statistical uncertainty estimates are needed.
Table 3 also does not explicitly identify the dataset, and its NeighFormer baseline differs from the results for both datasets in Table 1. The differences in experimental settings should be explained. The descriptions of data splits, trajectory window sampling, the custom NeighFormer architecture, and auxiliary network training are insufficient. Whether overlapping trajectory windows occur across splits remains unclear, and these omissions limit reproducibility. The authors should also explain how scene-level metrics are computed from consistent joint prediction samples and whether latency measurements include context acquisition and feature computation.
Questions for authors
see weaknesses.
Thank you for your detailed review. We address the main concerns below.
(W1) Our contribution lies in integrating longitudinal and lateral interaction information into an explicit neighbor-importance representation that can be added to different prediction backbones. The original kinematic features are retained, and the internal backbone architectures remain unchanged. Our objective is to evaluate the usefulness of this input-level representation across different prediction models.
(W2, W3) The experiments are intended to evaluate the representation across different backbone architectures rather than compare state-of-the-art prediction performance. We therefore include six backbones covering recurrent, generative, graph-based, transformer-based, and multi-agent prediction approaches. Our primary evaluation focuses on lane-structured driving environments. In addition to conventional highway scenarios, exiD includes merging, on-ramp, and off-ramp interactions.
(W4) During auxiliary slot-weight training, pre-/post-LC samples are classified using recorded lane-change events and directions. Context-specific slot weights are learned and fixed using their validation-set means. During trajectory prediction, the context is assigned using lane-ID transitions within the observed history. Pre-LC and post-LC weights are applied before and after an observed transition, respectively. If no transition is observed, lane-position-dependent weights are used. This inference-time procedure does not require future ground-truth maneuver labels or trajectories. We will clarify the distinction in Section 3.3 and Appendix A.4.
(W5, W8) The ablation study evaluates the proposed components under the same training configuration. Directly combining the longitudinal and lateral states performs worse than using the unified importance score. Although Slot weighting and neighbor filtering individually increase prediction errors, their combination achieves the lowest mean errors across all three metrics.
To further assess the consistency of these results, we have added mean and standard deviation values across three random seeds in Appendix C. The full configuration achieves an ADE of 0.2138 ± 0.0216, compared to 0.2394 ± 0.0231 for importance alone. While these results suggest complementary effects between Slot weighting and neighbor filtering, they do not establish the optimality of the individual design choices or statistical significance of the improvements.
(W6) The improvement varies across models and datasets. Some gains are small, and MTP-GO shows slightly worse minADE and minFDE on exiD. The reported 28.47% ADE reduction refers specifically to GRIP++ on exiD and is not intended to represent the improvement across all models.
(W7) The importance score is designed to represent neighbor interaction relevance rather than collision risk. Although Eq. (3) assigns equal importance to positive and negative longitudinal states with the same magnitude, the original kinematic features retain their directional information. We also acknowledge that the central quantization interval contains both positive and negative interaction times, so the sign is not strictly preserved in every interval. We will correct this description.
(W8) Table 3 reports the ablation study using Neighformer on exiD with 100 training epochs, whereas the main experiments in Table 1 use 200 epochs. All ablation configurations were trained under the same 100-epoch budget due to computational constraints. Therefore, Table 3 is intended for within-table component comparisons rather than direct comparison with Table 1. We will specify these settings in the revised manuscript.