- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
Enabling autonomous vehicles to follow passenger instructions is an important and practical research problem. SIC-Drive offers an interesting approach by integrating FiLM into SparseDriveV2's candidate scoring mechanism, allowing language instructions to influence planning decisions.
However, I have several concerns that prevent me from giving a higher score.
C1. Lack of key baseline comparisons. Instruction following is the paper's main objective, yet SIC-Drive is not compared with existing methods on Instruction Success Rate (ISR). Table 2 mainly reports conventional driving metrics, which do not establish superiority in instruction following. Comparisons with other language-conditioned driving methods, including VLA models, on DIF-Benchmark would be valuable.
C2. Unclear necessity of language augmentation. The contributions of Navigation Augmentation and Risk Warnings Augmentation are not adequately evaluated. In Table 3, Correct and Mute show relatively small differences in DS and SR. Since the instructions are derived largely from existing navigation and scene annotations, it remains unclear whether these augmentations provide meaningful additional information. Separate ablations would help clarify their contributions.
C3. Potential ambiguity in instruction success evaluation. A vehicle may slow down or avoid an obstacle even without receiving a warning. Should such behavior count as successful instruction following? Although DIF-Benchmark uses matched scenes, additional no-instruction controls would help distinguish instruction-induced behavior from default driving behavior.
C4. Execution of distance-constrained instructions. For instructions such as "Maintain your current direction of travel for [x] meters," SIC-Drive does not appear to include an explicit mechanism for tracking traveled distance. How does it ensure accurate execution of such constraints? Experiments with varying distance requirements would help.
C5. Instruction completion and termination. The benchmark uses predefined conditions to activate instructions and determine their completion. However, it is unclear how SIC-Drive would independently detect instruction completion and deactivate the instruction during real-world operation.
C6. Clarity of terminology. The paper is generally clear, but CARLA-specific fields such as "Command Far," "Command Near," and "affects_ego" are introduced without sufficient explanation. Brief definitions would improve accessibility for readers unfamiliar with CARLA.
Critical strengths
See above.
Critical weaknesses
See above.
Questions for authors
See above.