- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes CrimeGPT, an LLM-based framework for crime-count forecasting that integrates heterogeneous urban information with numerical prediction. The framework combines a Crime Dynamics Encoder for spatio-temporal modeling, dedicated numerical tokens with bidirectional ordinal supervision (BiCORN), and a Distribution-Guided Regression Head (DGRH) for continuous count estimation. Experiments across four cities, including cross-year evaluation and zero-shot cross-city transfer, demonstrate competitive forecasting performance.
Critical strengths
- The paper represents an early effort to apply large language models to crime prediction, exploring their potential to integrate heterogeneous urban information for forecasting.
- The experiments cover four cities and multiple crime categories, with comparisons against general forecasting models, crime-specific methods, and LLM-based approaches.
Critical weaknesses
- The claim that “… contextual factors that conventional statistical models largely overlook” is overstated. Earlier crime prediction approaches already incorporated urban context, including submissions to the NIJ Real-Time Crime Forecasting Challenge, DeepCrime, and Crime Rate Inference with Big Data.
- The motivation for using an LLM for crime prediction is not clear. The manuscript should explain which specific challenges require an LLM and why conventional spatio-temporal models are insufficient to address them.
- Limited numerical sensitivity appears to be a general limitation of LLMs rather than a challenge specific to crime forecasting. The distinctive challenges of crime prediction and the insufficiency of existing methods are still not clear.
- The comparison should place greater emphasis on LLM-based forecasting methods. The current baselines, dating from 2024 or earlier, are not sufficiently competitive given recent advances in time-series foundation models.
- Although results are averaged over three runs, Table 2 reports variability only for CrimeGPT, and some gains over competitive baselines are marginal.
Questions for authors
See weakness.
4 comments
Response (Part II)
Q4: Relationship to recent LLM-based forecasters and additional comparison.
A: Recent methods explore ways to represent time-series information for LLM-based forecasting. LagLLM [1] uses lead-lag dependencies, T3Time [2] uses temporal, spectral, and prompt representations, and MSH-LLM [3] uses multi-scale hypergraph features. These designs primarily concern the representation of forecasting inputs.
CrimeGPT additionally focuses on numerical-language alignment and numerical training objectives. CDE aligns heterogeneous urban dynamics with the LLM's semantic space. BiCORN and DGRH address diffuse predictions through ordinal and explicit distance supervision, respectively, which is particularly relevant to noisy, multi-source crime observations.
We additionally evaluate MSH-LLM [3], an ICLR 2026 method, using the same horizons, chronological splits, and available crime and 311 histories.
Table C2: Additional comparison with MSH-LLM.
| City | Crime category | MSH-LLM MAE ↓ | MSH-LLM RMSE ↓ | CrimeGPT MAE ↓ | CrimeGPT RMSE ↓ |
|---|---|---|---|---|---|
| NYC | All | 3.624 | 5.042 | 3.537 | 4.921 |
| NYC | Theft | 2.361 | 3.376 | 2.286 | 3.285 |
| NYC | Assault | 2.065 | 2.897 | 2.036 | 2.880 |
| Chicago | All | 2.566 | 3.612 | 2.530 | 3.598 |
| Chicago | Theft | 1.764 | 2.519 | 1.716 | 2.466 |
| Chicago | Assault | 1.211 | 1.734 | 1.193 | 1.742 |
| Philadelphia | All | 3.129 | 4.262 | 3.017 | 4.139 |
| Philadelphia | Theft | 1.996 | 2.725 | 1.908 | 2.666 |
| Philadelphia | Assault | 1.535 | 2.126 | 1.511 | 2.119 |
| Shanghai | All | 0.794 | 1.456 | 0.735 | 1.345 |
We will incorporate this comparison into the revised manuscript.
Q5: Result variability and gains across forecasting settings.
A: We will add standard deviations from the existing experimental runs to Table 2.
As discussed in Section 5.4, Advantages of CrimeGPT, the gains are clearer in high-frequency, complex settings such as NYC All Crime, where richer observations and a wider count range make contextual and numerical modeling more useful. Figure 4(a) likewise shows clearer gains in high-frequency NYC regions.
SHA provides a contrasting sparse setting: 53.69% of test targets are zero, and an all-zero predictor yields an MAE of 0.837. This helps explain the comparatively modest gains there. The results suggest that CrimeGPT's advantages are more pronounced in information-rich, complex settings, with smaller gains when contextual information and count variation are limited.
References
[1] Wu, B., Zhou, J., Shang, Z., and Chen, L. (2026). LagLLM: LLM-empowered lead-lag dependency learning for spatial-temporal time series forecasting. ICML.
[2] Chowdhury, A. M., Akter, R., and Arib, S. H. (2026). T3Time: Tri-Modal Time Series Forecasting via Adaptive Multi-Head Alignment and Residual Fusion. AAAI.
[3] Shang, Z., Cui, D., Wu, B., and Chen, L. (2026). Multi-scale hypergraph meets LLMs: Aligning large language models for time series analysis. ICLR.
More evidences need insightful analysis or specific examples.
The authors primarily explain they use LLMs for semantic understanding and contextual reasoning, for example, regional functions and calendar descriptions. However, it is still not intuitive. More evidences need insightful analysis or specific examples. And, the new explanations may need to reorganize the paper contents. Therefore, I maintain my scores.
Thank you for your time and thoughtful feedback throughout the review process.
Response (Part I)
Thank you for recognizing our exploration of LLM-based crime forecasting and the breadth of the evaluation.
In response to your comments, we will expand the language-model controls and comparisons with recent LLM-based forecasting methods, add baseline standard deviations, and clarify how CrimeGPT builds on context-aware crime forecasting. Our responses below further explain the role of language capabilities, the crime-specific challenges, and the variation in gains across forecasting settings.
Q1: Positioning CrimeGPT within context-aware crime forecasting.
A: Thank you for highlighting these foundational studies. Earlier crime forecasting methods already incorporate urban context, and we will clarify this relationship in Related Work. Our contribution concerns how heterogeneous urban information is aligned with a language model and used for numerical prediction.
CDE encodes crime and service-request histories with spatial relationships, then projects them into the LLM's semantic space. The LLM processes these dynamics alongside regional and calendar descriptions. BiCORN and DGRH further provide ordinal and explicit distance supervision. CrimeGPT builds on context-aware forecasting through numerical-language alignment and task-specific numerical supervision.
Q2: Motivation and empirical support for the language-model pathway.
A: Crime forecasting depends on recent urban dynamics and the meaning of the regional context in which they occur. Similar counts can arise in regions with different functions and activity patterns. Beyond model capacity, the LLM provides pretrained language knowledge for semantic understanding and contextual reasoning. It interprets regional functions and calendar descriptions and relates them to CDE's numerical representation, allowing the forecast to reflect both recent observations and their urban context.
We evaluated CDE + MLP with L1 alone and with auxiliary CE + BiCORN. We also included random and pretrained Qwen2.5-1.5B controls with CDE, regional prompts, and MLP regression, both using L1 + CE + BiCORN.
Table C1: Encoder and language-model controls on NYC All Crime 2022.
Relative to CDE + MLP with auxiliary supervision, CrimeGPT reduces MAE and RMSE by 12.3% and 13.9%, respectively. In the reported 1.5B comparison, the pretrained configuration obtains lower MAE/RMSE than the randomly initialized configuration. Table 3(e) further shows that removing contextual prompts raises MAE/RMSE from 3.537/4.921 to 3.582/4.989. Together, these comparisons support using pretrained language representations and regional semantics alongside recent numerical dynamics.
Q3: Distinctive challenges of crime forecasting and limitations of existing methods.
A: Thank you for the opportunity to clarify this motivation. Numerical sensitivity is relevant to LLM forecasting generally. Crime prediction makes it particularly consequential through noisy, heterogeneous observations whose relevance depends on regional and temporal context.
CrimeGPT addresses both the interpretation of heterogeneous urban evidence and the numerical uncertainty associated with crime-count prediction.