- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
In this paper, the authors propose an event-triggered mechanism for planning assistance from VLMs in autonomous driving. To decide when to refresh cached semantic guidance, the Event Trigger Module (ETM) utilizes fast and slow temporal streams to capture visual changes over different time scales, combining these features with ego and cache states to estimate the need for semantic refresh. ETM learns from heuristic trigger labels and risk scores with the training objective, i.e., risk-weighted focal loss for trigger classification and the auxiliary score regression loss. During inference, the VLM is invoked when the trigger probability exceeds a threshold or the cache exceeds its limits. Otherwise, the planner reuses the cached semantic guidance. All experiments are conducted on the nuScenes benchmark. The reported results show that ETM reduces computational costs through selective VLM invocation while improving overall planning performance. However, I still have several concerns, as detailed below.
Critical strengths
- The paper investigates how to bring the capabilities of strong VLMs into autonomous driving at a lower computational cost, which is a timely and valuable research direction given the rapid progress of VLMs.
- ETM is designed to leverage VLM assistance in rare and challenging driving scenarios. It focuses on the long tail of the driving distribution, giving the approach practical potential for real-world applications.
- The paper is clearly written and supported by informative visualizations, making the approach easy to follow. The overall framework is also straightforward to implement.
Critical weaknesses
-
The main concern is that experimental results and analysis are unable to support the benefits of ETM.
(a) Trigger supervision. ETM is trained using heuristic labels derived from corner cases, changes in ego motion, and other predefined conditions. However, this paper does not verify whether invoking the VLM on frames labeled as requiring a trigger actually improves planning. The validity of these hand-crafted trigger labels therefore remains unclear.
(b) Benefits across scenario types. Furthermore, overall performance improvements do not establish whether difficult scenarios benefit or whether easy scenarios avoid degradation. Besides, as shown in Table 2, the 3 s L2 and collision results are relatively similar. Despite the computational savings, the evidence for improved planning performance remains limited without separate analyses of various scenarios.
-
Generalization ability of ETM. ETM relies on relatively complex and heavy hand-crafted rules and thresholds, raising concerns about its generalization across datasets. It remains unclear whether the configuration selected on nuScenes can also bring performance improvements on datasets such as OpenScene or Waymo. More evaluation is necessary to determine whether ETM is able to retain meaningful performance gains under such transfer.
Minor Issues
- "event trigger" should be "event-triggered" on Page 9.
Questions for authors
It is suggested that the authors provide further clarification and supporting evidence to address the weaknesses discussed above. In particular, the effectiveness of ETM (Weakness 1) and generalization ability (Weakness 2) require further validation.