- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates how LLMs internally represent event relations and use them to make moral judgments. The authors propose ENACT, a three-stage causal framework, and introduce MoralTrace, a synthetic diagnostic dataset for controlled counterfactual interventions. They analyze moral-patient representations, causal attribution, and relational binding across different models, followed by circuit-level analysis and generalization experiments.
Critical strengths
The paper includes extensive experiments across 27 models from 11 model families, using controlled counterfactual prompts, causal interventions on internal representations, and circuit-level analyses to investigate the mechanisms underlying moral judgments in LLMs.
Critical weaknesses
The paper is difficult to follow, starting from the introduction. The authors do not provide a self-contained introduction to the Theory of Dyadic Morality. The proposed three sequential causal transitions are also not sufficiently motivated. Simply referring to prior work is not enough, the paper should provide a clearer justification for why this particular causal structure is appropriate. It is difficult to understand how the experiments in Sections 3–5 support the proposed causal framework, particularly how they establish the sequential dependencies between the individual components.
Questions for authors
-
How were the representative models in Table 2 selected? The full results in Table 8 seems more mixed, so it is helpful to discuss the selection process and the overall consistency of the findings across models.
-
The proposed MoralTrace dataset was generated and validatied by an LLM with manual review on examples flagged by the validating LLM. It would be helpful to see some quantitative results for the LLM-based and maual validation. How many examples were flagged? How many of the flagged examples were excluded? Is there any manual check on examples that pass LLM validatin?
-
How does the proposed ENACT framework for moral reasoning connect to more general causal or relational reasoning?
-
How is rank 4 chosed for distributed alignment search?
3 comments
Response to Reviewer G7yv
Dear Reviewer G7yv,
Thank you for pointing out that the connection between TDM, the operators, and the experiments was difficult to follow. In preparing the original submission, we spent much of our time organizing the experimental results and underestimated how much explanation readers would need to see why each test followed from the framework. We learned a lot from going back through the paper with that question in mind.
In the final revision, we moved Figure 1 into the Introduction, rewrote parts of §§2–3 to explain how the framework leads to the experimental comparisons, and added Table 1 to show how the explicit-patient, implicit-patient, and matched control conditions are constructed. We also retitled §3.3 Causal Contribution of Patient Completion and explain alongside the results that removing the patient component can lower wrongness ratings even when the written intention answer is held fixed.
In §4.2, we replaced the earlier joint-effect table with the token-level plot previously in the appendix (now Figure 5) and revised the text and caption to explain what the plot tests. We moved the takeaways to the start of §§3–5 and reorganized the appendices so each research question points to its methods, controls, and full results.
We appreciate your careful reading. Your questions helped us explain how the experiments bear on the framework one step at a time.
Thank you for the detailed response. The explanations help clarify how the individual experiments connect to the proposed framework.
The revised presentation addresses some of my concerns, but I'm still not fully convinced that the evidence supports the broader claims about the proposed mechanism. I will maintain my score.
Response to Reviewer G7yv
Thank you for pointing out that the original paper introduced TDM and the three operators without enough explanation of how the experiments test them. We revised §2.1 to explain the theory and state the contrast for each operator, and added an intervention in §3.3 that tests whether patient completion affects attributed intention.
Why these operators, and what depends on what? TDM treats perceived harm as a relation between an agent and a vulnerable patient, with norm violation and negative affect also contributing to condemnation. We use this relation to construct independent contrasts. In the office example illustrated in Figure 2b, Rachel opens a window, Ethan’s report pages scatter, and he misses a deadline. In §3, leaving the affected person implicit tests whether the model represents Ethan as the patient. In §4.1, a gust from another, already-open window changes who caused the outcome while holding the missed deadline fixed. Crossing source with valence tests whether the outcome changes intention primarily for the causal agent. In §4.4, a duty to secure the pages illustrates how the same event can be judged under different rules. The criterion-replacement experiment implements that contrast in an allocation task. Section 5.1 traces the source–valence update through attention and MLP outputs to the late subspace.
Adding the rank-two completion component changed intention ratings by +1.28 points in Llama-3.1-8B, +1.77 in Gemma-2-9B, and +0.03 in Qwen2.5-14B. Removing it lowered wrongness in all three, even when the written intention answer was fixed (§3.3, Appendix B.2, lines 1551–1565). These tests show that patient information can affect intention and can also affect wrongness when the explicit intention answer is held fixed. A single obligatory sequence through an internal intention state remains unestablished.
Q1. Model selection and consistency. Table 1 shows examples from several model families and three Qwen2.5 sizes, allowing comparison across families and within one family. We now report the aggregate pattern in §3.3 and the full results in Table 11 (Table 8 in the submission). Counts below use model-level pointwise 95% bootstrap intervals excluding zero.
Fifteen of 27 models showed both predicted responses when counting each intervention across ranks. At rank two, removal increased wrongness in five models and its interval spanned zero in ten. Addition was more consistent than removal.
Q2. Validation counts. The authors reviewed the hand-written templates. The generation model was also used in a separate temperature-zero semantic check for unintended cues about intention, damage, or emotional reactions. Appendix D.6 reports the available generation logs.
The denominators count generation attempts. The archived records do not establish how many items the semantic check flagged, how many were excluded after manual review, or whether passing items were manually spot-checked.
Q3. Relation to general causal reasoning. The same causal relation can inform a judgment of responsibility for a loss or an assessment of whether an operation caused a system failure. We hold the event graph fixed across moral, coordination, and technical tasks. Coordination retains the interpersonal setting while changing what counts as a poor action. In §5.2, transferring the activation difference induced by reassigning a cause recovered 56%–109% of the full-state intention shift across 16 cross-domain transfers in three models. This supports reuse of a causal update across these tasks. The criterion intervention (§4.4, Appendix B.9) separately tests how the applicable standard influences the final judgment.
Q4. Rank four in DAS. Four was a fixed subspace size for comparing patient, intention, and outcome-severity interventions with their same-rank random controls. We varied the layer and kept rank and training settings fixed (§3.1, Appendix A.4, lines 960–971). We did not run a rank sweep for this experiment.