- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors tackle the problem that GPS samples are often sparse and rarely coincide with street-view image coordinates, making it diffucult to align dynamic trajectory information with static geospatial representations. They then propose TrajGANR as a multimodal self-supervised learning framwork that treat each trajectory as a neural field, allowing localized mobility embeddings to be queried at arbitrary coordinates through contrastive learning among three different modalities.
Tested on four road-segment-level tasks across two city areas, TrajGANR outperforms image-based geospatial pretraining models and a trajectory foundation model. The authors then prove the TrajGANR's ability to generalize outside the obersved trajectories through a single POI popularity prediction task.
Critical strengths
- The paper is well motivated: there's often a mismatch between the locations where vehicles' GPS samples are collected and those where street-view images are captured. While it's widely recognized that human mobility is valuable in geospatial pretraining, the authors claim that there's no existing framework that aligns GPS trajectories with static geospatial representations.
- The model's generalizability to off-network locations is tested against existing pretrained location encoders and shows improved performance.
- The methodology is clearly described.
Critical weaknesses
- The paper frames its contribution around the form vs. function of urban space. However, with trajectories at road level, the learned signal seems to reflect traffic behaviour rather than function (how people use places), and the downstream tasks are mostly traffic-related. Moreover, prior work has already aligned mobility data with other urban modalities, with a similar form-vs-function motivation [1,2,3]. The paper should at least position itself conceptually against this line of work.
- The paper emphrasizes on the value of fine granularity a lot while all evaluation downstream labels are defined at the road-segment level, so the benefit seems not directly evaluated. Can authors include some tasks at fine-grained levels?
- The method assigns a synthetic timestamp to the query location. which is essentially linear interpolation. It is therefore unclear how much the proposed "neural implicit field" adds beyond simple interpolation, e.g., linearly interpolating the embeddings of the neighboring GPS points. Please justify this concept and show that the gain comes from contextual modeling rather than interpolation alone.
- The authors state that evaluation locations and street-view images are unseen during fine-tuning, but were they seen during pretraining? If so, the setting is transductive and results may be inflated by spatial autocorrelation. Please clarify.
[1] Wen, Ya, et al. "MoRA: Mobility as the backbone for geospatial representation learning at scale." International Conference on Learning Representations. Vol. 2026. 2026.
[2] Zhou, Silin, et al. "Heterogeneous region embedding with prompt learning." Proceedings of the AAAI conference on artificial intelligence. Vol. 37. No. 4. 2023.
[3] Li, Zechen, et al. "Urban region embedding via multi-view contrastive prediction." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 38. No. 8. 2024.
Questions for authors
See weaknesses.
4 comments
Response to Reviewer yt6j (2/2)
W3 “The method assigns a synthetic timestamp to the query location. which is essentially linear interpolation. It is therefore unclear how much the proposed "neural implicit field" adds beyond simple interpolation, e.g., linearly interpolating the embeddings of the neighboring GPS points. Please justify this concept and show that the gain comes from contextual modeling rather than interpolation alone.”
Answer. Only the query's timestamp is interpolated, not its location or its representation. The query is placed at the street-view image's own coordinate, which often lies 20–50 m off the GPS path, and its embedding is computed by self-attention over the entire trajectory, so each query is contextualized by the full trip rather than by its two neighboring points. To test whether the gain depends on interpolation, our paper includes a masked-time variant (Table 7) that removes the interpolated timestamp entirely and replaces it with a learned token, leaving the model to infer the query's position in the trip from context alone. This variant performs close to the full model. Table 5 further shows that what TrajGANR learns goes beyond interpolation: its location encoder represents locations from coordinates alone, with no trajectory available at inference and therefore no neighboring GPS points to interpolate, and still outperforms all baselines. The gain therefore comes from contextual modeling rather than from interpolation.
W4 “The authors state that evaluation locations and street-view images are unseen during fine-tuning, but were they seen during pretraining? If so, the setting is transductive and results may be inflated by spatial autocorrelation. Please clarify.”
Answer. Our spatial split over the road network applies to both pretraining and fine-tuning. We have revised the Appendix to state this explicitly. In addition, the POI popularity task in Table 5 evaluates locations away from the road network, which were not part of pretraining at all.
Thank you for your response. Figures 3 and 4 provide useful illustrations of within-segment variation and the potential benefits of fine-grained alignment. However, I still see limited contributions of trajectory-centric fine-grained learning in broader non-traffic scenarios. Therefore, I maintain my original rating.
We thank the reviewer for the follow-up. We are glad Figures 3 and 4 were helpful. We emphasize that our core contribution is the alignment of raw GPS trajectories with street-view images and locations in multimodal self-supervised learning, which no prior work does. Both TrajGANR (Segment-based) and TrajGANR (Fine-grain) are instances of this contribution, and both clearly outperform existing segment-level trajectory models and established GeoFMs on diverse urban tasks including static tasks (e.g, on San Francisco AOI function, both reduce error by 66% over the strongest existing segment-level model). Fine-grained alignment then adds further gains where within-segment variation matters, on traffic speed, hard braking, and point-level POI popularity. Could the reviewer specify which concern about the non-traffic evaluation remains unaddressed?
Response to Reviewer yt6j (1/2)
W1a “The paper frames its contribution around the form vs. function of urban space. However, with trajectories at road level, the learned signal seems to reflect traffic behaviour rather than function (how people use places), and the downstream tasks are mostly traffic-related.”
Answer. TrajGANR encodes how people navigate the city and use urban space, not traffic conditions alone. This is because it aligns each individual, whole trajectory with every location it passes, so a location's representation reflects where those trips start and end, which neighborhoods they connect, when they happen, and whether vehicles pass by or stop there. Our tasks directly reflect this: traffic speed and hard braking events test driving behavior, while the other three, road popularity (navigation demand to destinations along a road), AOI function (the surrounding mix of POI categories), and POI popularity (visit demand to individual venues), measure how places are used. Trajectories improve all three place-use tasks: adding them raises road popularity F1 from 0.921 to 0.960 and reduces AOI function error by 54% (Table 4), and pretraining with them improves POI popularity F1 by 28% over GAIR (Table 5).
W1b “Moreover, prior work has already aligned mobility data with other urban modalities, with a similar form-vs-function motivation [1,2,3]. The paper should at least position itself conceptually against this line of work.”
Answer. While [1–3] share the motivation that human movement reveals urban function, they model macro region-level socioeconomic patterns from aggregated origin-destination (OD) flows, whereas TrajGANR models micro coordinate-level representations from raw GPS trajectories. We have revised the related work to position TrajGANR within this line of work: HREP [2] and ReCP [3] partition a city into zones (such as Census tracts) and represent movement as OD trip counts, that is, how many trips start in zone i and end in zone j, together with POI data. ReCP, for instance, starts from taxi trips but keeps only these counts, discarding the route taken in between. MoRA [1] builds a flow graph between coarse H3 cells (~36 km² each) and aligns it with POIs, demographics, and satellite imagery. In all three, every modality is aggregated to the same zone or cell, so different modalities are co-located by construction and can be aligned directly using standard contrastive learning techniques. This alignment is not possible with raw GPS trajectories: a trajectory is a continuous path rather than a property of a fixed unit, and its sparse GPS samples rarely coincide with the locations where street-view images are taken. TrajGANR addresses this by representing each trajectory as a continuous function queried at exact image coordinates, which yields micro, coordinate-level representations that link how a specific location is driven to what it looks like.
W2 “The paper emphrasizes on the value of fine granularity a lot while all evaluation downstream labels are defined at the road-segment level, so the benefit seems not directly evaluated. Can authors include some tasks at fine-grained levels?”
Answer. The granularity of prediction labels need not determine the granularity of representation learning. To illustrate this, we added two new visualizations to the revised paper. The first (Fig. 3) shows that conditions vary within a segment: along a single 180 m segment, movement contexts change from a busy intersection toward a residential neighborhood. Segment-based alignment assigns every coordinate the same trajectory embedding, obscuring this variation. Our granularity ablation confirms its practical importance: coordinate-level alignment reduces prediction error by 43% for traffic speed and 60% for hard braking events (Table 3), despite segment-level labels. We also extended the individual-POI popularity evaluation (where the labels are per POI coordinate) to include the segment-based variant. Using the pretrained location encoder from coordinates alone, coordinate-level alignment achieves F1 = 0.317 vs 0.304 (Table 5). The second visualization (Fig. 4) illustrates how coordinate-level alignment helps preserve distinctions between neighboring POIs that segment-based alignment collapses.