Despite the compelling motivation, I have two major concerns regarding the experimental validation and whether the reported results sufficiently support the paper's central claims.
W1. Insufficient evaluation across benchmarks
The experimental evaluation is rather limited, as the paper reports results only on NAVSIM v1.
This is particularly concerning given that several earlier approaches discussed in the related work already provide evaluations on multiple benchmarks. For instance, SeerDrive, published approximately one year earlier, reports results on both NAVSIM and nuScenes.
Furthermore, recent works in this area commonly evaluate their methods on at least two benchmarks selected from NAVSIM (v1/v2), nuScenes, NAVHARD, Bench2Drive, HUGSIM, and others.
While I do not expect every paper to cover all these benchmarks, evaluating the proposed method exclusively on NAVSIM v1 makes it difficult to assess its generalizability and robustness across different driving scenarios and evaluation protocols.
This limitation is especially important because the paper proposes a modeling principle that is intended to address a relatively general issue in autonomous driving world models, rather than a benchmark-specific optimization.
Consequently, I believe the current evaluation is insufficient to fully substantiate the broader claims of the paper.
W2. Insufficient evidence that the improvements originate from the proposed agent-centric modeling
Predicting future BEV representations is not a new research direction. Therefore, the key contribution that distinguishes this paper from previous works should be the explicit treatment of surrounding agents as independent entities rather than background scene content.
Intuitively, this formulation should lead to better modeling of surrounding agents' future behaviors and trajectories, which should subsequently improve ego-vehicle planning.
However, the paper does not provide sufficiently direct evidence supporting this causal relationship.
First, the evaluation of surrounding-agent prediction is insufficient.
Although Table 4 reports future BEV semantic segmentation performance, the evaluation remains rather ambiguous.
In particular, the definition of the eight semantic categories is unclear, and the reported mIoU of 31.8% is not particularly convincing without further analysis.
For reference, SeerDrive reports an mIoU of 38.87%. I fully acknowledge that the experimental settings differ and that these numbers should not be directly compared. Nevertheless, the reported 31.8% does not, by itself, establish that the proposed approach achieves particularly strong future scene prediction.
More importantly, without class-wise results, it is difficult to determine whether the relatively low overall mIoU is primarily caused by challenging or underrepresented categories, such as pedestrians, or whether prediction quality is consistently limited across categories.
Given the proposed formulation, I believe a more informative evaluation would be to directly assess the future trajectories of the 15 selected surrounding agents against their ground-truth trajectories, rather than relying primarily on an aggregated semantic segmentation mIoU.
Such an evaluation would more directly examine whether the proposed method improves the modeling of other agents, which appears to be the central motivation of the paper.
Second, the claims regarding spatial completeness and ego-agent consistency are not sufficiently validated.
For a method that explicitly emphasizes spatial completeness and ego-agent consistency, reporting only an aggregated future BEV mIoU is insufficient to evaluate these properties.
In particular, I would expect a more fine-grained analysis distinguishing:
- Regions already observable in the original ego-centric BEV representation from regions beyond its spatial coverage.
- Ego-centric future BEV predictions from agent-centric future BEV predictions.
- Static semantic categories, such as roads and map elements, from dynamic categories, such as vehicles.
- Prediction consistency between ego-centric and agent-centric viewpoints after aligning their predictions to the same physical region in a common coordinate frame.
The fourth point is particularly important.
As explicitly stated by the authors after Eq. (4) on page 5, the method does not introduce an explicit consistency loss. Instead, consistency is encouraged indirectly through shared parameters and consistent ground-truth future labels.
While this design is reasonable, it also makes direct empirical verification of cross-view consistency particularly important.
An improvement in overall future BEV mIoU does not necessarily demonstrate that predictions from different vehicle viewpoints are more consistent with one another.
Therefore, the current results do not sufficiently establish whether the proposed approach achieves the claimed improvements in spatial completeness and ego-agent consistency.
Third, the paper lacks qualitative comparisons that could help explain the source of the planning improvements.
I did not find a qualitative comparison illustrating how the proposed agent-centric modeling changes the resulting planning behavior.
For example, it would be valuable to compare representative scenarios in which surrounding agents are treated as ordinary scene content against scenarios using the proposed agent-centric formulation.
Such visualizations could help demonstrate whether explicitly modeling surrounding agents leads to more reasonable ego-vehicle trajectories, especially in situations involving interactions with other vehicles.
Without these analyses, it remains difficult to determine whether the observed planning improvements genuinely originate from the proposed agent-centric modeling principle or primarily from the additional supervision introduced by future BEV prediction.
This concern becomes even more consequential given the limited benchmark coverage discussed in W1. When cross-benchmark validation is insufficient, detailed analyses of the proposed mechanism become particularly important.
Overall, while I find the motivation compelling, I believe the current experiments do not yet provide sufficiently convincing evidence that the proposed agent-centric formulation, rather than auxiliary future BEV supervision in general, is responsible for the observed improvements.
My initial rating for this paper is 1.
To be honest, I feel that this score is somewhat lower than what the paper deserves in terms of its research motivation. I genuinely appreciate the motivation behind this work, as it addresses a real and challenging problem in autonomous driving world models.
In particular, I believe the distinction between modeling surrounding agents as independent decision-making entities and treating them as ordinary scene content is both meaningful and worth investigating.
However, the weaknesses in the current experimental validation are also substantial. Most importantly, the paper does not yet provide sufficiently direct evidence that its reported improvements originate from the proposed agent-centric modeling principle.
If a finer-grained rating scale were available, I would place this paper somewhere between 1 and 2, perhaps around 1.5, but slightly closer to 2 than my current discrete rating suggests.
I am open to revising my score depending on the authors' responses, particularly if they can provide additional evidence addressing the concerns regarding evaluation coverage, agent trajectory modeling, and cross-view consistency.