- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Irrelevant audio can degrade text reasoning and increase output instability in large audio-language models (LALMs). This work introduces ICAP-Gate, a mechanism-guided, task-conditioned approach to controlling audio pathways to mitigate such instability.
Critical strengths
The paper focuses on an important robustness challenge in LALMs: prediction instability induced by task-irrelevant audio. By jointly evaluating Influence Rate and Answer Flip, the study provides a comprehensive evaluation of audio interference, supported by experiments across multiple models and diverse audio interference conditions.
Critical weaknesses
My main concern is that the proposed routing mechanism relies on a keyword-based rule rather than a learned or semantic relevance-aware approach. This raises serious concerns about whether the method can reliably determine when audio information is needed.
My second critical concern is that the paper evaluates audio capability preservation only through ASR, without considering comprehensive audio understanding and reasoning benchmarks such as MMAU or MMAR. Furthermore, ICAP-Gate sets the gating factor to 1 for explicit ASR instructions, making its behavior identical to ungated inference by construction. Therefore, the identical WER results in Table 6(a) provide limited evidence of effective selective modality control.
The paper does not clearly explain why the selected late audio layers are more effective than other layers. Comparisons with simpler methods, such as audio masking, or with alternative layer selections are needed to justify the proposed mechanism-guided approach.
Questions for authors
How does the instruction-conditioned router handle implicit audio requests?
Could you include a learnable instruction-conditioned router as a comparison?
Could you evaluate audio understanding on benchmarks such as MMAU or MMAR?
Could you explain why the selected late audio layers are more effective than simpler approaches, such as audio masking or selecting other layers?