- Rating
- 4
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes TRUST-AD, a benchmark for evaluating the textual robustness of MLLMs in autonomous driving when given the same visual information. The benchmark includes 14,238 instances across 6 defined safety-critical driving categories. For each image, the paper provides 7 different prompt templates, including no information, information, suggestive, counterfactual, visual clue, rule injection, and visual clue & rule injection. Models are fed the same image input but with these different prompt templates. The paper evaluates 37 MLLMs, including open-source/commercial and general-purpose/domain-fine-tuned models. Experimental results show that (1) MLLMs' performance varies largely under different prompts, more than the sampling variability of the same prompt; (2) improvements in accuracy do not have a clear correlation with textual robustness; (3) a counterfactual prompt can mislead models; and (4) models reduce reliance on visual evidence when informative text is provided.
Critical strengths
1. Comprehensive evaluation and detailed analysis with interesting findings.
The paper conducts a large-scale (i.e., 37 MLLMs across 17 families) evaluation of MLLMs on the proposed benchmark. I especially appreciate the authors' effort in the analysis part, which considers (1) different prompt templates vs. sampling randomness; (2) relations between accuracy (also release timeline) and robustness; (3) failure attribution to different prompt templates; (4) general MLLMs vs. specialized MLLMs; and (5) visual contribution under each text prompt template.
I enjoy reading the findings, and some of them are surprising to see (e.g., newly released models do not necessarily improve textual bias), which I think might also benefit the broader ICLR community.
2. A carefully designed benchmark can benefit future research.
The proposed benchmark can be used by future research to evaluate the MLLM textual robustness in autonomous driving. From what I read, the benchmark and the metrics are well-designed and ready for use, which clearly meet the bar for a benchmark paper.
Critical weaknesses
1. The visual grounding contribution experiment can be more rigorous.
This concern does not impact my overall assessment of the paper, but I think it could strengthen the claim. In the visual grounding contribution experiment (Sec. 5.6), the paper claims that MLLMs reduce their reliance on visual evidence with informative text input (VC, RI, and VRI).
This conclusion is based on the performance gap between (a) text-only input and (b) image-text input. However, in scenarios where the answer can be fully inferred from the text alone, it's expected that adding an image does not bring further improvement. At least from the example I saw in the appendix, most answers can be derived from the VRI alone. Therefore, to claim that MLLMs reduce visual reliance, results-based analysis is not enough; the authors are suggested to probe intermediate indicators, e.g., attention score among image and text, etc. This can make the claim more supported.
Questions for authors
This is suggested for future work, not a clarification issue.
- In Figure 7, the paper observes that Alpamayo-1.5 is more robust to the
CFprompt. I'm wondering if that is because the model is more dominated by visual input and less influenced by text in general. From Table 16, it seems Alpamayo also shows moderate improvement inVC,RI, andVRI. Thus, the MLLM degrading less to counterfactual (CF) text prompts might not be because it's genuinely more robust, but because it is less influenced by text in general; So we might need to consider both (1) how much they improve overVRIand (2) how much they degrade overCF. Figure 7 only captures one side of it.