- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ACHER for multimodal fake news detection, motivated by the distinction between conflicting cross-modal evidence and insufficient counterpart evidence. It estimates evidence availability through bidirectional sparse localization with null-hypothesis competition, and combines availability with conditional conflict estimates to form compatible, conflicting, and unverified state probabilities in each direction. These states are further organized into four state-gated evidence mechanisms for final prediction. Experiments on Weibo, FineFake, and AMG show competitive or improved performance over the reported baselines, while ablations and interventions provide evidence consistent with the intended distinction between evidence availability and conditional relations.
Critical strengths
- Multi-faceted mechanistic validation: The paper goes beyond standard classification metrics by probing module behavior through targeted evidence deletion, availability-controlled counterpart replacement, and mechanism knockouts across different regimes. While these interventions do not fully prove the semantic meaning of the internal states, they provide much stronger empirical grounding for the model's design than mere accuracy gains or t-SNE visualizations.
- Consistent ablation support for the proposed structure: Removing availability modeling, bidirectional reasoning, state gating, or any of the four mechanisms consistently degrades performance on both Weibo and FineFake. This provides solid empirical backing that the proposed components have practical predictive value, rather than being purely conceptual additions.
Critical weaknesses
- Lack of independent validation for core latent variables: The concepts of "availability" and "conditional conflict" are learned primarily through the final classification loss and the model's own structural objectives, lacking independent annotations to verify they truly represent "evidence sufficiency" and "semantic conflict." While targeted deletion shows the model is sensitive to its own localized candidates, it does not rule out that these states are merely task-specific gating signals. Since the paper's main contribution hinges on the semantic interpretation of these states, this validation gap weakens the core claim.
- Insufficient isolation of the symmetric-antisymmetric decomposition's contribution: The performance drop when replacing this decomposition with direct concatenation is significant. However, the paper does not clarify if this ablation variant maintains the exact same parameter count, mechanism branches, state gating, and auxiliary training objectives. Without this, it is difficult to attribute the performance gap solely to the decomposition method itself, rather than confounding structural or optimization changes.
Questions for authors
- Do you have any independent annotations or strictly controlled examples (decoupled from the model's own outputs) that can verify "availability" and "conditional conflict" truly correspond to evidence sufficiency and semantic conflict, rather than just acting as generic classification gating signals?
- For the "direct concatenation" ablation, does the variant maintain the exact same parameter scale, mechanism branches, state gating, and auxiliary training objectives as the full model? Please specify exactly what was changed in this variant so we can determine if the performance drop is genuinely attributable to the decomposition method itself.
Semantic Validation and Controlled Ablation of Structured Reasoning
We thank the reviewer for the constructive feedback. We provide complementary semantic validation and controlled-ablation evidence to clarify the roles of ACHER's evidence states and the contribution of structured bidirectional reasoning.
Q1. Semantic validation of Availability and Conditional Conflict
Answer: We thank the reviewer for requesting independent semantic validation. We provide complementary evidence from human annotations, controlled interventions, and external visual-entailment evaluation.
Q2. Controlled ablation of symmetric–antisymmetric decomposition
Answer: The original direct-concatenation ablation tests the overall structured mechanism design, not decomposition alone. We added a more controlled variant that retains the four experts, state gating, and training objectives to better isolate feature organization.
We will clarify the experimental configurations and incorporate these results into the revised manuscript.