- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes TopoEnhance, a framework for improving topology connections in driving scenes. The authors point out that existing methods still have a considerable performance gap compared with their theoretical upper bounds, and that the quality of the final discrete topology graphs is not sufficiently evaluated. To address these issues, the authors introduce a topology noise simulation strategy and train a heterogeneous GNN to refine connectivity predictions. The refined scores are then combined with the original predictions without retraining the baseline models. The paper also introduces Topology Jaccard Similarity (TJS) to evaluate discrete connections. Experiments on OpenLane-V2 show consistent improvements across several existing methods.
Critical strengths
- The paper addresses a meaningful problem in driving scene topology reasoning. Reliable topology connections are important for downstream tasks such as path planning. The authors highlight the need to evaluate the quality of the final discrete topology graphs, which is not fully reflected by commonly reported topology metrics. Introducing TJS as a complementary evaluation metric is a useful contribution.
- The experimental results are promising. TopoEnhance improves both TOP and TJS across several baselines, including TopoNet, TopoMLP, TopoLogic, and SMART. The improvements in TJS are particularly substantial. These results demonstrate the potential of improving topology predictions without retraining the original models.
- The paper provides useful additional experiments beyond the standard benchmark results. The evaluations on geographical generalization, temporal consistency, safety-related topology errors, and route recoverability help demonstrate the potential practical value of the proposed method.
Critical weaknesses
- The methodological novelty is not sufficiently clear. The proposed framework mainly combines noise augmentation, a heterogeneous GNN, and score fusion, which are relatively established techniques. Previous works such as TopoLogic have also explored improving topology predictions through geometric information and post-processing. Although the proposed framework achieves promising results, its main methodological contribution over existing approaches needs to be better justified. Comparisons with simpler refinement methods would help clarify this point.
- The large improvements in TJS require further analysis. The paper uses a fixed threshold of 0.5 to convert topology scores into discrete connections. However, different baseline models may produce scores with different distributions. As a result, the relatively low TJS scores of the original models may partly result from the threshold choice rather than poor topology reasoning alone. It is therefore unclear how much of the reported improvement comes from better structural predictions and how much comes from changes in score calibration. Comparisons with baselines using individually tuned thresholds or simple calibration methods would help address this concern.
- The contribution of the proposed noise simulation strategy is not sufficiently isolated. It remains unclear whether the performance improvements mainly come from the noise simulation and denoising formulation, or from the additional GNN trained to predict topology connections. A comparison with a standard supervised GNN trained without the proposed noise simulation would help establish the necessity of the denoising design.
- The distinction between TOP and TJS could be explained more clearly. The paper describes TOP as a metric for continuous topology scores and TJS as a metric for discrete connections. However, the official OpenLane-V2 implementation also applies confidence thresholding when computing topology AP. A more precise discussion of the differences between these metrics, particularly regarding thresholding and the evaluation of discrete connections, would strengthen the motivation for introducing TJS.
Questions for authors
- How sensitive are the reported TJS results to the confidence threshold? Could the authors report results under different thresholds and compare against baselines with thresholds tuned on a separate validation split?
- How does TopoEnhance compare with simpler approaches, such as score calibration or geometry-based post-processing? Such comparisons would help clarify the benefits of the proposed framework over existing alternatives.
- Could the authors provide an ablation study using a standard supervised GNN without the proposed noise simulation strategy? This would help isolate the contribution of the denoising formulation.
- Could the authors clarify the differences between TOP and TJS, particularly regarding confidence thresholding and the evaluation of discrete topology connections?