- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
AVID benchmarks omni-modal language models on detecting, classifying, temporally localizing, and explaining audio-visual inconsistencies. Built from LongVALE through audio interventions and human filtering, it covers eight inconsistency categories across 11.2K videos. The authors evaluate segment and full-video settings and provide a fine-tuned baseline, AVID-Qwen.
Critical strengths
The paper addresses a useful gap in omni-model evaluation by combining inconsistency detection, classification, localization, and explanation, particularly for multiple events in long videos. The construction pipeline is systematic, with human filtering, annotation-agreement studies, and source-video-disjoint splits. Modality ablations and consistent-TTS controls provide meaningful evidence that the task requires audiovisual information. The broad model evaluation, training ablations, general-mixture experiment, and DAVE transfer further demonstrate the dataset's challenge and training utility.
Critical weaknesses
-
AVID's added capability over the closest existing audio-visual conflict benchmarks needs clearer positioning. The relationship between AVID and AV-ConfuseBench is not discussed. AVID's eight-category taxonomy and multi-event setting are valuable additions. A direct comparison of conflict types, reasoning requirements, and representative model failures would clarify which previously untested abilities AVID evaluates and how it extends existing benchmarks.
-
The long-video evaluation needs a clearer reference point for its central contribution of multi-event localization and explanation. Section 3.5 describes the short clips as containing self-contained evidence, while the full-video task requires finding multiple such events. Tables 2 and 5 establish substantial difficulty and the benefit of full-video supervision, but do not compare full-video inference with a simple same-backbone window-based detection and interval-merging baseline. This comparison would help distinguish limitations in local inconsistency recognition from temporal search and handling long inputs, and better contextualize the full-video results. It would also provide a useful practical reference for future benchmark users.
-
As a supplementary comparison, we suggest including representative current closed-source omni models, such as Gemini 3.8 Flash, Qwen3.5-Omni, and Qwen3.8-Omni-Flash.
Questions for authors
Please refer to the Critical Weaknesses above.