- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors propose a constraint-based generation framework using domain-specific SCMs to mitigate causal hallucinations in LLMs. Unlike existing hallucination mitigation methods that mainly focus on factual correctness or output consistency, the proposed framework verifies causal claims against predefined causal graphs and iteratively revises generated responses based on detected violations. The authors further formulate this process using Lagrangian relaxation and primal-dual optimization, along with a theoretical analysis. The main contribution of this work is extending conventional fact-based hallucination mitigation to causal validity verification and incorporating it into the LLM generation process.
Critical strengths
-
The paper presents a well-motivated problem formulation focusing on causal hallucinations and clearly identifies a fundamental limitation of current LLMs, which is their inability to fully guarantee the validity of generated causal claims.
-
Although causality in LLMs has been extensively studied, it is interesting that this work connects causality with hallucinations by treating them as violations of constraints defined by domain-specific SCM.
-
The paper clearly presents its research objectives and motivations.
-
The authors provide detailed discussions of failure cases, limitations, and implementation bugs encountered during the experiments, which improves the transparency of the study and helps readers better assess the reliability of the findings.
-
An interesting aspect of this work is that it connects causal verification to the actual process of revising generated responses, rather than using the verifier solely for post-hoc error detection.
Critical weaknesses
-
Section 3.1 explains that reference graphs can be constructed from clinical guidelines or knowledge bases, and Appendix A.3 provides the topics and node-edge structures of the graphs used. However, it is unclear what sources and criteria were used to define each relationship and how the validity of these relationships was verified.
-
The paper lacks concrete examples showing how causal errors in generated responses are identified and corrected through the proposed framework. I think including qualitative examples in the main text would help readers better understand the proposed approach and improve the overall presentation of the paper.
-
The appendix acknowledges an inconsistency between the step-size assumption and the claimed convergence rate, and states that the theorem's assumptions or conclusions need to be revised. Since this directly affects the correctness of the theoretical contribution, I believe the authors should revise the theorem in Section 3.4 to reflect the corrected assumptions and guarantees, rather than leaving this issue only in the appendix.
-
It appears that the proposed intervention-effect verification and primal-dual optimization have not been directly implemented or evaluated on actual LLMs. Therefore, the current experiments appear insufficient to demonstrate the practical effectiveness of the full proposed framework, and its generalizability to broader hallucination scenarios remains unclear.
Questions for authors
Although Section 3.2 distinguishes between ASSOC and CAUSE, Section 5.1 appears to apply the same directed-path criterion to both types. However, two variables can be associated through a common cause without having a directed causal path between them. Could the authors clarify how the proposed method avoids incorrectly identifying such valid associations as causal errors?