- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes LogicCon, a multimodal logical conflict reasoning benchmark that requires models to (1) detect conflicts, (2) localize the conflicting fact pair, and (3) diagnose the conflict type. This benchmark covers five types of conflicts, including attribute, object, relation, spatial, and quantity conflicts. The main contribution is a verifiable data generation pipeline and a plug-in module to enhance the conflict reasoning ability of multimodal models.
Critical strengths
-
The authors released their code with detailed instructions.
-
This paper includes the latest models into their benchmark, e.g., Qwen3.5 in 9B and 27B.
-
The representation is clear to solve an essential task in multimodal models.
Critical weaknesses
-
Lack of novelty: Compared with previous work (MMIR, CLASH and so on), this benchmark differs mainly on extending the conflict localization. It’s helpful to highlight the core contribution in a few words.
-
The four-module reasoning framework is a cascaded band-aid, with limited theoretical support.
-
Formatting-1: Fig.1 and Fig.2 have very narrow space to the main text. It’s hard to distinguish the figure caption from main text.
-
Formatting-2: Line 111, the citation for “cross” (original name “CLASH”) is incomplete, should be CVPRF’26.
Questions for authors
-
Will CoT models gain benefits in conflict detection? E.g. compare LLaVA with LLaVA-CoT.
-
Will your plug-in framework introduce substantial latency in test time?