- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes RAP, a retrieval-augmented framework that combines historical incident knowledge, experience accumulation, and LLM-based phased reasoning to improve traffic flow prediction under non-recurrent traffic incidents.
Critical strengths
The paper has a clear motivation and presents a coherent overall story. The experimental results demonstrate some improvements over existing methods.
Critical weaknesses
W1. Limited evidence supporting the effectiveness and necessity of the core modules.
I think the effectiveness of the core method may need further experimental validation. In the ablation study, although the paper emphasizes the importance of Phased Prediction and Experience Accumulation, removing these two modules actually leads to a slight improvement in MAPE. While the performance in terms of MAE and RMSE decreases slightly, the overall differences are relatively small. Therefore, I think the authors should further clarify under what conditions these two modules are necessary and whether their improvements are sufficiently consistent. Since these modules are also among the main contributions of the paper, the current ablation results raise some questions about their necessity.
W2. Relatively high inference latency.
Although the authors provide some efficiency analysis in the appendix and reduce inference time through layering, the average processing time is still around 129 seconds per incident. I think this latency is relatively high for downstream applications such as traffic flow prediction, which can be time-sensitive. It would be helpful to further discuss the trade-off between accuracy and efficiency, particularly whether the accuracy improvements achieved by RAP are sufficient to justify the additional inference latency and computational cost compared with existing lightweight methods.
W3. Lack of analysis of experimental stability.
I did not find results reporting the variance or confidence intervals across multiple runs. Considering that the method involves LLM-based reasoning and that some of the reported improvements are relatively small, I think it would be useful to further evaluate the stability of the results.
W4. Potentially missing retrieval-augmented baselines.
Although the current baselines cover a number of traditional traffic forecasting methods, I think the evaluation could benefit from a stronger non-LLM retrieval-augmented baseline. For example, using the same historical retrieval information, a simpler retrieval-based correction or lightweight fusion approach could be considered. Such a comparison would help clarify how much of RAP's improvement comes from retrieval itself and how much comes from LLM-based reasoning. I think this distinction is important for demonstrating the necessity of the proposed method.
Questions for authors
N/A