- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work proposes an LLM-guided multi-agent reinforcement learning framework for emergency vehicle traffic signal control. It combines probabilistic LSTM-based arrival-time prediction, LLM-generated phase preferences, and UGAT for cross-environment adaptation. Experiments cover five scenarios across three urban road networks. In the Jinan high-demand scenario, the method reduces overall vehicle and emergency vehicle average travel time by 24.96% and 44.88%, respectively, compared with fixed-time control.
Critical strengths
- The paper addresses the practical trade-off between prioritizing emergency vehicles and maintaining overall traffic efficiency.
- Combining arrival-time prediction, LLM-guided phase preferences, and multi-agent reinforcement learning offers a promising direction for emergency vehicle signal control.
Critical weaknesses
- Insufficient literature support in the introduction. The discussion of the research background and limitations of existing methods lacks adequate references, making the motivation and its relationship to prior work less clear.
- Limited coverage of emergency vehicle control baselines. The evaluation mainly compares the proposed method with fixed-time control, MA2C, and HGAT, but does not include specialized emergency vehicle control methods discussed in the related work, such as EMVLight. This makes it difficult to assess the method's advantages over existing approaches designed specifically for emergency vehicle prioritization.
- Lack of direct validation for ETA prediction. The paper reports neither ETA prediction errors on a held-out test set nor uncertainty calibration metrics. It is therefore difficult to assess the accuracy and reliability of this component directly.
- Insufficient details on the LLM implementation. The paper mentions DeepSeek but does not specify the exact model version or provide key details such as the prompt templates. These omissions limit reproducibility.
- Unclear uncertainty modeling in UGAT. Equation (9) describes the prediction of the next observation but does not explicitly specify the corresponding predictive distribution, leaving some ambiguity regarding the probabilistic forward model described in the paper.
- Lack of statistical analysis of experimental results. Table 1 reports only point estimates, without specifying the number of independent training runs or providing standard deviations, confidence intervals, or significance tests. It is therefore difficult to determine whether the reported improvements are robust.
Questions for authors
- What are the specific algorithmic differences between the proposed UGAT variant and the method introduced by Da et al. (2023)? Could the authors compare their approach directly with the original UGAT or provide an ablation study isolating the contribution of the modified uncertainty criterion?
- Which exact DeepSeek model and version were used? Could the authors provide the prompt templates, decoding settings, and invocation procedure, and compare the proposed method against a preference mechanism that does not use an LLM under otherwise identical settings?
5 comments
UGAT Uncertainty Modeling and Comparison with the Original Method—Weakness 5; Question 1 and LLM Implementation and Preference-Generation Comparisons—Weakness 4; Question 2
Relative to F0, F1 lowers overall ATT by 15.42 s and EMV ATT by 31.63 s, and raises throughput by 7 vehicles, while AWC rises from 1.55 to 1.65. F2 is worse than F0 and F1 on overall ATT, throughput, and AWC. In Figures 18 and 19, 90% of F1 trips have a waiting-time share below 9.0%, versus 20.8% for F2. The medians are 1.9% and 3.7%.
The cross-city evaluation is reported separately. A policy trained on Hangzhou is transferred to Jinan-Low without using Jinan-specific data for training or adaptation. Both the Jinan-trained reference policy and the transferred Hangzhou policy are evaluated in SUMO under the same 4365-vehicle demand. The results are shown in Table R3.
Table R3. Cross-city transfer performance from Hangzhou to Jinan-Low.
| Setting | Overall ATT | EMV ATT | TP | AWC | CO2 | Fuel |
|---|---|---|---|---|---|---|
| Proposed Jinan-Low, trained in Jinan | 291.67 | 112.22 | 4142 | 2.01 | 639.59 | 204.00 |
| Hangzhou policy tested on Jinan-Low | 409.64 | 106.11 | 3021 | 2.53 | 956.02 | 304.93 |
EMV ATT falls from 112.22 s to 106.11 s, but overall ATT rises from 291.67 s to 409.64 s and throughput falls from 4142 to 3021. Figures 20 and 21 show the resulting congestion, and more than one thousand vehicles remain unfinished.
These results demonstrate that the Hangzhou-trained policy can be evaluated on a different city network without Jinan-specific training, but its overall traffic performance remains substantially below that of the Jinan-trained policy. Accordingly, this experiment is described as cross-city transfer without target-city training, rather than evidence of consistently successful cross-network generalization. The Hangzhou experiment is separately characterized as cross-simulator target-environment adaptation because SUMO data are used to train the forward model. It is therefore not described as strict zero-shot transfer across simulators.
2.4 Reliability of entropy-based uncertainty estimation.
At four central Hangzhou intersections, MADQN and the inverse model stayed frozen, and UGAT did not change the executed phase. After each transition, the inverse model predicted that phase. A mismatch was counted as an error. The 2396 decisions were grouped by entropy.
The aggregate results are reported in Table R4. The estimated error rate increases from 5.9% in the lowest-entropy interval to 39.7%, 68.4%, and 87.9% in the three higher-entropy intervals, respectively. The lowest-entropy interval contains 2146 of the 2396 transitions, accounting for approximately 89.6% of the samples. The individual intersection results show that the error rate in this interval ranges from 4.6% to 7.0%, although the relationship is not strictly monotonic across every interval at every intersection.
Table R4. Inverse-model action-prediction error across entropy intervals.
| Entropy interval | Number of transitions | Estimated incorrect predictions | Weighted error rate |
|---|---|---|---|
| 0–0.42 | 2,146 | 127 | 5.9% |
| 0.42–0.83 | 141 | 56 | 39.7% |
| 0.83–1.25 | 76 | 52 | 68.4% |
| 1.25–1.66 | 33 | 29 | 87.9% |
| Total | 2,396 | 264 | 11.0% |
These results indicate that higher inverse-model entropy is generally associated with a higher probability of action-prediction errors, whereas low entropy is associated with substantially more reliable predictions. Nevertheless, low entropy does not guarantee correctness, and the observed relationship should be interpreted as an empirical reliability indicator rather than a formal guarantee of action accuracy.
3. LLM Implementation and Preference-Generation Comparisons—Weakness 4; Question 2
3.1 Model Configuration and Invocation Procedure
The LLM used in the experiments is DeepSeek-Flash. The decoding temperature is set to 0.7, and the maximum number of generated tokens is 2000.
The LLM is invoked through blocking API calls. A new preference update is requested every ten simulation steps and when an emergency-vehicle event triggers an update. The generated preference vector contains eight phase-preference values for each intersection. The preferences are normalized so that the values at each intersection lie in ([0,1]) and sum to one.
The prompt consists of a task instruction and a traffic-information input. The task instruction asks the model to act as a traffic-signal expert and assign a preference to each of the eight phases at each intersection. A higher preference indicates that the corresponding phase should be activated sooner. At each intersection, the eight preferences are constrained to ([0,1]) and must sum to one. The instruction asks the model to consider both queued regular traffic and emergency-vehicle priority, and to increase the preference of phases that allow approaching emergency vehicles to pass.
LLM Implementation and Preference-Generation Comparisons—Weakness 4; Question 2 and Direct Evaluation of ETA Prediction and Uncertainty Calibration—Weakness 3
The traffic-information input contains the total number of waiting vehicles associated with each phase at every intersection. For each emergency vehicle, it also provides the vehicle's current speed, remaining distance, the speed and distance of the vehicle ahead, its current intersection, subsequent intersections on its planned route when available, and the phases that permit passage at the current and downstream intersections. If the format check fails, the model is prompted again, with up to three attempts. If the output remains invalid after these attempts, the preference residual is set to zero.
3.2 Comparison with Non-LLM Preference-Generation Mechanisms
On Hangzhou we kept the pretrained MADQN, ETA features, and UGAT fixed, and changed only the preference source: none, a queue rule with an EMV bonus, an MLP using the same numerical inputs, uniform, random, and the LLM.
The LLM has the lowest overall ATT (368.84 s) and EMV ATT (184.75 s). The rule and MLP lower overall ATT but raise EMV ATT above MADQN, to 205.62 s and 196.12 s. Random reaches 189.25 s EMV ATT without a matching overall-ATT gain.
Table R5. Performance comparison of different preference-generation strategies on the Hangzhou 4×4 network.
| Method | Overall ATT | EMV ATT | TP | R_change |
|---|---|---|---|---|
| A0 MADQN | 404.59 | 193.25 | 2598 | 0 |
| A2 MLP | 381.10 | 196.12 | 2696 | 41.1% |
| A3 Uniform | 420.32 | 201.62 | 2667 | 0 |
| A3 Random | 409.46 | 189.25 | 2687 | 64.5% |
| A4 Rule-based | 380.28 | 205.62 | 2696 | 40.7% |
| A5 LLM | 368.84 | 184.75 | 2700 | 39.2% |
The action-change ratios are 40.7% (rule), 41.1% (MLP), 64.5% (random), and 39.2% (LLM). Uniform changes no action, because the same value on every phase does not change the ranking. Figures 22 and 23 show that the lowest EMV ATT is not the setting that changes the most actions, and this ordering holds in the second half of the 3600 s run.
4. Direct Evaluation of ETA Prediction and Uncertainty Calibration—Weakness 3
4.1 ETA prediction accuracy and uncertainty calibration.
On trajectory-disjoint Hangzhou data we compare C0μ (always 24.5 s), C0 (distance/speed), C1 (deterministic LSTM), and C2 (heteroscedastic LSTM with Gaussian NLL). Of 89 EMV trajectories, 86 were split by vehicle into 60/13/13 for training, validation, and test. The target is time to first arrival at the current intersection. Nine test vehicles produced 115 overlapping 10-step windows, so the windows are not independent; vehicle-averaged MAE was also checked.
Table R6. ETA prediction accuracy and uncertainty evaluation on the trajectory-disjoint Hangzhou test set.
| Method | MAE (s) | RMSE (s) | NLL | PICP@95% | MPIW (s) |
|---|---|---|---|---|---|
| C0μ Constant training-set mean | 26.14 | 35.91 | 5.00 | 0.95 | 146.5 |
| C0 Distance/Speed | 21.73 | 31.10 | — | — | — |
| C1 Deterministic LSTM | 22.52 | 33.11 | 5.01 | 0.83 | 98.9 |
| C2 Probabilistic LSTM | 20.51 | 30.78 | 4.84 | 0.93 | 113.3 |
C2 achieves the lowest point-prediction errors among the four estimators. Compared with C1, it reduces MAE by approximately 8.93% and RMSE by 7.05%. Compared with C0, the reductions are approximately 5.62% and 1.03%, respectively. These results indicate a modest improvement from probabilistic ETA modeling .
C2's standard deviation is multiplied by 1.71687 and floored at 27.9705 s, both fit on validation only. Its test PICP@95% is 0.93 and its MPIW is 113.3 s. C1 uses one residual standard deviation, 25.2197 s, giving PICP 0.83 and MPIW 98.9 s. C0 has no predictive distribution. C2 is calibrated, but its intervals are wide. The results show that C2 provides useful predictive uncertainty estimates after validation-based calibration, although its relatively wide prediction intervals should be considered when interpreting the coverage result.
4.2 Cross-policy evaluation of the frozen ETA predictor.
Changes in the MADQN policy may alter future traffic conditions and remaining travel-time distributions, potentially introducing prediction bias. To investigate this issue, we conducted an additional cross-policy evaluation.Under the reference MADQN policy (P0), C2 achieved an MAE of 20.51 s. The same predictor was then evaluated on newly collected Hangzhou trajectories generated by a newly trained MADQN controller (P2), using the same additional EMV demand.
Under P2, C2 achieved an MAE of 19.32 s. However, the mean predicted remaining time was 16.8 s, compared with a ground-truth mean of 29.1 s, corresponding to a systematic underestimation of 12.3 s. Figure 24 in the revised manuscript shows the residual distribution.
These findings suggest that the frozen ETA predictor retains a usable aggregate point-error level under the additional policy, but they do not establish robust prediction under arbitrary policy changes or resolve the predictor-controller coupling.
Research Background and Motivation—Weakness 1 and UGAT Uncertainty Modeling and Comparison with the Original Method—Weakness 5; Question 1
We sincerely thank the reviewer for the positive assessment of the practical relevance of this work and for the constructive comments.
1. Research Background and Motivation—Weakness 1
We appreciate the reviewer's comment on the insufficient literature support in the Introduction. The original manuscript did not provide a sufficiently detailed discussion of the development of emergency-vehicle signal control and the limitations of existing approaches. This made the motivation for combining ETA prediction, LLM-generated phase preferences, and multi-agent reinforcement learning less explicit. The first two paragraphs of the Introduction will cite the EMV and transfer papers, including EMVLight (Su et al., 2022; 2023), the original UGAT (Da et al., 2023) and so on. Each citation will be attached to a specific limitation of that line of work.
2. UGAT Uncertainty Modeling and Comparison with the Original Method—Weakness 5; Question 1
2.1 Forward and Inverse Model Outputs.
The forward model is a deterministic point predictor of the next observation. It is trained using mean squared error and does not output a probability distribution or an observation-uncertainty estimate. The inverse model takes an observed state transition as input and predicts a categorical distribution over possible actions. It is trained using cross-entropy loss. UGAT uses the Shannon entropy of the inverse action distribution. That is not the LSTM ETA variance.
2.2 UGAT methodology and comparison with the original implementation.
The forward–inverse grounding framework comes from Da et al. (2023). Both versions use a target-domain forward model and a source-domain inverse model, and replace the policy action only when uncertainty is low. Ours trains the forward model on SUMO and the inverse model on CityFlow with cross-entropy. Uncertainty is the Shannon entropy of the inverse action distribution, compared with a fixed threshold. Original UGAT uses an evidential inverse model, Dirichlet vacuity, and an adaptive threshold. Our entropy measures action ambiguity, not the joint uncertainty of the two models. The fixed threshold avoids fluctuations from updating the threshold online.
To evaluate these differences, we conducted a direct comparison among the proposed implementation, the original UGAT mechanism, and the configuration without UGAT adaptation. The results are summarized in Table R1.
Table R1. Performance comparison of different uncertainty-guided action grounding strategies on the Hangzhou network.
Ours has the lowest overall ATT (368.8 s) and the highest throughput (2700). Original UGAT has a lower EMV ATT (176.4 s) but a much worse overall ATT (457.7 s) and throughput (2427). This comparison indicates that the original UGAT provides stronger emergency-vehicle prioritization in this scenario, but at a substantially greater cost to general traffic efficiency.
Figure 16 in the revised manuscript presents the cumulative EMV ATT over simulation time. The original UGAT eventually achieves the lowest EMV ATT, consistent with Table R1, but this advantage is accompanied by worse overall traffic efficiency. These results help distinguish the different operating characteristics of the two grounding mechanisms rather than suggesting that one configuration is uniformly superior. Figure 17 in the revised manuscript further illustrates the screening behavior of the original UGAT. Under its EDL-based mechanism, 51.3% of candidate decisions are accepted. The adaptive threshold changes to 0.51 in response to recent uncertainty estimates.
2.3 Target-environment adaptation and cross-city transfer.
We further compare three settings: F0, the configuration without UGAT adaptation; F1, the proposed method using SUMO records to train the forward model; and F2, a matched-budget fine-tuning baseline initialized from F0 and further trained using a different Hangzhou traffic flow before evaluation on the same test flow. The results are reported in Table R2.
Table R2. Comparison of target-environment adaptation and matched-budget policy fine-tuning on Hangzhou.