- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper frames its task as trajectory generation, although it is closer to routing, as both the origin and destination are specified in advance. Its central argument is that prior work has not made effective use of POI data and therefore has not fully captured the urban context surrounding road segments. The authors aim to better leverage this information to improve the quality of generated trajectories. Specifically, they propose a new method for processing POI data and feed the resulting information into a Siamese Transformer-based architecture to incorporate the urban context along the route into trajectory generation. The reported results show that, given an origin–destination pair, the generated trajectories more closely resemble real-world trajectories in terms of several trajectory-level statistics.
Critical strengths
- The proposed POI preprocessing method helps make more effective use of the available data, and incorporating the surrounding urban context into road-segment representations is a sensible design.
- The experimental results show clear improvements over comparable baselines, and the ablation studies exhibit consistent overall trends across all three cities.
Critical weaknesses
- The paper’s contribution is confined to the narrowly defined task of representing road segments within trajectories, which substantially limits its broader applicability.
- The model architecture follows a fairly straightforward design and offers limited methodological novelty. It provides few new insights or design principles that readers could draw on beyond this particular task.
- The POI preprocessing pipeline does involve some deliberate design choices. However, it largely amounts to combining a range of existing, straightforward techniques rather than introducing a particularly novel or insightful approach to extracting urban semantics.
- The model relies on multiple conditioning inputs, including the origin and destination. It remains unclear whether the reported performance would hold without these additional constraints, which further limits the approach’s applicability. As noted in my summary, specifying both endpoints effectively narrows the task from general trajectory generation to routing between fixed locations.
- The paper’s writing and problem framing need further refinement. In particular, the challenges presented in the introduction appear to describe necessary processing steps rather than substantive research challenges.
- From the perspective of origin–destination pairs, a strong relationship between trip intention and urban functional context is reasonable. However, once the origin and destination are fixed, route choice is often driven primarily by shortest-path, as reflected by Dijkstra in the paper, with other variations often arising from dynamic traffic conditions and user-equilibrium effects. Urban context may still be relevant, but its role in routing appears more limited and less fundamental than the paper’s motivation suggests.
Questions for authors
- Some of the baselines are autoregressive models. How are these models conditioned on the destination? If they are not given the destination, the comparison would be unfair, as the proposed model has access to additional input information that these baselines do not receive.
- Do the gains from the environmental branch come from its explicit prediction objective or simply from the additional model capacity? The full model differs from the “w/o Env Branch” variant not only in the inclusion of , but also in the presence of a separate Transformer. This ablation therefore does not disentangle the effect of the prediction objective from that of the increased model capacity.
6 comments
Response to Reviewer MXB6 (2/4) — Urban semantics, OD, and environmental relevance
W3. The POI design implements a coherent insight
Our insight is that urban semantics must be represented at complementary granularities and learned according to their relevance to movement. Similar category densities can conceal different individual facilities and different relationships between those facilities and a road. Local facilities and representative landmarks also provide different information. A useful environmental representation must retain these distinctions and learn how they matter for each trajectory unit.
The hierarchy follows this reasoning. Instance attention learns relevance within Local and Landmark; source attention learns the contribution of Macro, Local, and Landmark to each road. Candidate construction supplies observations, while the learned tokenizer and trajectory objectives determine how those observations become useful environmental representations. The resulting tokens are then modeled as an independent sequence with explicit predictive supervision.
The source ablations support this insight. Adding Local to Macro improves all four metrics in every city. Adding Landmark to Macro+Local further improves Distance, Radius, and Duration in every city. The full three-source model improves all four metrics over Macro alone. Together with the sequence and supervision ablations, these results validate the effectiveness of the proposed environmental representation and its use in generation.
Existing retrieval, attention, and Transformer operations are the means by which we turn this insight into measurable gains. The use of established operations does not justify reducing the work to those operations or dismissing the contributions of the modeling formulation, the distinctions it preserves, and the supporting experimental evidence. MUSE offers a coherent and reusable approach to learning trajectory-relevant urban semantics, extending well beyond a collection of preprocessing operations.
W4. Fixed OD still leaves a substantive trajectory generation problem
OD specifies the request, not the trajectory. MUSE learns p(trajectory | O, D, t₁): a distribution over timestamped road sequences given origin, destination, and departure time. It must generate intermediate roads, corridors, detours, transition times, and trip durations.
Even with identical endpoints and departure time, trips vary with intermediate activities, preferences, and circumstances. Departure time also changes route and speed distributions. Shortest-path routing optimizes a chosen path cost; trajectory generation learns the distribution and spatiotemporal diversity of observed movement. OD does not reduce this task to shortest-path routing.
OD is part of an established task formulation, not a methodological advantage claimed by MUSE. Autoregressive TS-TrajGen and HOSER and diffusion-based DiffTraj and Cardiff also use OD. Our contribution is the environmental modeling framework and its gains within this task. This setting serves demand-conditioned mobility simulation: a demand model supplies requests, and a generator produces the corresponding trajectories. Applicability should be assessed in this established setting.
W6. Fixed OD does not eliminate the role of the urban environment
Shortest paths and traffic are important influences on travel, but they do not fully describe urban movement. A taxi may change its route because a passenger changes the destination, a road is temporarily closed, or congestion builds during peak hours. A private traveler may avoid busy school or hospital access roads, while a shared ride may involve a pickup outside the most direct corridor. The final recorded endpoints leave these intermediate decisions and their temporal effects unresolved.
These examples illustrate why route choice reflects interacting causes at several levels, including trip activities, access to facilities, preferences, traffic, and network constraints. Urban functions shape where activities occur and how travelers access them. Exploring the causal mechanisms behind urban mobility, including these environmental influences, is a central motivation for MUSE. We start from road-network sequences and explicitly model the surrounding environment to capture information about movement that road topology and endpoints alone do not provide.
The claim that environmental context becomes secondary once OD is fixed therefore needs to be tested empirically. Our experiments directly address it. On the same OD pairs, MUSE reduces Distance JSD by 66.1%–77.8% and regional visitation JSD by 78.0%–81.5% relative to Dijkstra. This establishes a substantial gap between shortest-path outputs and observed mobility distributions. The controls in Part 4 isolate the environmental contribution within the learned generator.
Response to Reviewer MXB6 (3/4) — Baseline fairness and research challenges
Q1. Destination conditioning and faithful baseline reproduction
We adapt each released baseline implementation to the city datasets while retaining its published network architecture, training objective, complete native conditioning inputs, and recommended training and sampling settings. Learned baselines are retrained separately for each city on the same 80/10/10 splits. We do not modify their networks to force a uniform conditioning interface. The original mechanisms are as follows.
| Method | Origin and destination interface | Other inputs or priors |
|---|---|---|
| TS-TrajGen | O initializes the prefix, D enters cost estimation | Departure time, A* heuristic, regional guidance |
| HOSER | O initializes the prefix, D guides the navigator | Departure time, road/regional encodings, path search |
| DiffTraj | OD grid embeddings condition denoising | Departure time, reference road count, duration and distance |
| Cardiff | OD grid embeddings enter both diffusion stages | Departure time, trip length/duration, coarse-road latent |
| MobilityGPT | Road-prefix continuation, no fixed D | Connectivity mask, gravity-based training sampling |
| Seed | 20-road prefix, no separate OD pair | Conditional diffusion |
| MoveSim | No fixed OD | POI-category similarity, time embeddings, distance/history |
| Dijkstra | OD specifies path endpoints | Road lengths and topology |
| MUSE | O initializes the prefix, D token enters both streams | Departure time, regional features, topology, POIs |
In particular, TS-TrajGen and HOSER use the destination through cost estimation and navigation, respectively. The autoregressive comparison therefore includes methods that already use D and their original search or structural priors.
HOSER and MUSE receive the same origin road, destination road, and departure time. Under these shared request conditions, MUSE reduces Duration JSD by 64.6%–79.4%. The distributional evaluation uses three MUSE samples and one deterministic HOSER trajectory per request. The MUSE ablations also retain the same request inputs throughout. These comparisons show that the environmental modeling gains cannot be attributed to providing MUSE alone with the destination.
A further evaluation supplies both models with the same observed road and time prefixes and the true next road at each step. With the route controlled, MUSE reduces whole-trip travel-time MAE by 50.4%–67.5% across all 12 city and route-length groups. Thus, its temporal advantage persists when route choice is fixed. We will include the method-specific conditioning interfaces in Appendix H to make the comparison transparent.
W5. Substantive challenges and clearer presentation
We will follow the suggestion to sharpen the Introduction and make the research challenges more explicit. The underlying difficulty is the mismatch between environmental observations and the trajectory sequence to be generated.
Ambiguous spatial and semantic correspondence. POIs have heterogeneous meanings and spatial supports. One facility may relate to several roads, while a road may have many nearby facilities whose relevance differs. Proximity alone does not resolve these associations. The research challenge is to learn which observations characterize a trajectory unit and how to align them into a useful environmental view.
Complementary information at different granularities. Category statistics preserve functional composition but discard individual facilities; instance sets retain detail but introduce redundancy and uneven coverage. Local facilities and landmarks have different representational roles. The challenge is to preserve useful distinctions while learning their relative contributions, rather than lose information through a single uniform summary.
Learning how environmental history affects generation. Environmental observations are static and unordered, whereas movement is a dynamic sequence of road transitions and times. Merely making POIs available does not teach a model how the encountered environment relates to subsequent movement. The challenge is to learn a predictive environmental history and coordinate it with the road history during generation.
These are representation and learning problems that explain the multi-source hierarchy, independent branches, and environmental supervision. We will make this connection explicit in the Introduction, clarify the two token vocabularies and hidden-state fusion around Figure 2, and connect the design rationale to the ablation evidence.
Response to Reviewer MXB6 (1/4) — Contributions and methodological novelty
Thank you for recognizing the consistent improvements across all three cities. We would like to clarify the environmental modeling contribution underlying these results.
W1. MUSE contributes an independent environmental modeling framework
Road-segment representations are a foundation of road-network trajectory modeling. MUSE builds on this foundation by modeling Road and Environment separately, from token representation to sequence dynamics, and integrating them at the sequence hidden-state level (Sections 3.2–3.5). Environmental information is not incorporated into the initial Road token. The Road tokenizer represents road attributes, topology, and regional context; the Environment tokenizer learns a separate vocabulary aligned to the same road indices.
This environmental representation preserves both statistical and instance-level information. Macro describes the aggregate composition of nearby POI categories. Instance representations retain facility semantics and road-relative geometry. We further separate instances into Local and Landmark sources to distinguish the contributions of nearby facilities and representative functional anchors. Road Query first aggregates instances within each instance source, then fuses Macro, Local, and Landmark through source attention. This hierarchy provides a road-aligned environmental representation while preserving the distinctions among the three sources during aggregation.
The two token sequences enter separate causal Transformers. The Environment branch learns the encountered environmental history and receives its own next-road prediction supervision. Its hidden states interact with the Road hidden states through a learned gate, and the fused states support road and time prediction. Environmental representation learning, alignment and fusion of data and representations, independent sequence modeling, and engineering design choices such as predictive supervision are all core contributions of MUSE. Describing the work only as road-segment representation leaves out this complete environmental modeling framework.
The broader insight is to make unordered, heterogeneous environmental observations an independently learned predictive view aligned with the units of a structured sequence. This is a general sequence-modeling perspective, instantiated here with roads and POIs. Across three separately trained city models, MUSE improves all four distributional metrics over the road-only variant, with Duration JSD reductions of 32.2%–67.6%. These results establish the value of explicit environmental modeling for trajectory generation and provide a concrete basis for incorporating environmental context into other spatiotemporal modeling tasks.
W2. Methodological novelty and reusable design principles
MUSE contributes new insight at both the representation and sequence-modeling levels: preserve complementary environmental granularities, learn environmental history as its own predictive sequence, and use supervised interaction between the structural and environmental views to generate movement.
The ablations substantiate these design principles. With both branches retained, the full multi-granular representation improves all four JSDs over Macro alone in every city, reducing Duration JSD by 11.0%–32.9%. This establishes the benefit of jointly representing statistical context and individual facilities.
With the same multi-granular environmental inputs, the full model improves all four JSDs over the single-branch feature-concatenation variant, reducing Duration JSD by 19.7%–52.5% (Table 3). This demonstrates the effectiveness of the combined design of independent sequence modeling, hidden-state interaction, and environmental supervision.
The new experiments in Part 4 further isolate the auxiliary objective and compare environmental and road inputs with identical architecture and parameter count. They show that both explicit environmental supervision and meaningful environmental content contribute to the gains. Thus, the representation design, sequence architecture, and training choices yield concrete, experimentally supported guidance that readers can use when integrating heterogeneous context into sequence models. This contribution directly addresses the questions of methodological novelty and informativeness.