- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates the detection of implicit moral coercion in multi-turn dialogues. The authors introduce COERCION, a dataset of 4,700 dialogues constructed from social media interactions, supplemented by GPT-4o-generated examples and human annotations. Each dialogue is labeled for the presence of moral coercion and its intensity on a 0–5 scale. The paper further decomposes moral coercion into four psychological dimensions: Obligation, Constraint, Value Judgement, and Toxicity. Based on these dimensions, the authors propose a two-stage framework that first extracts dimension-specific features and then incorporates them alongside the original dialogue for coercion detection and intensity prediction.
The experiments evaluate cross-domain generalization, in-domain fine-tuning, and coercion intensity prediction, together with ablation studies on the proposed psychological dimensions. Fine-tuning on COERCION achieves binary classification F1 scores of approximately 0.84-0.85 and intensity prediction accuracy of around 76%. Incorporating dimension-specific features also improves detection performance over direct classification baselines. The ablation results suggest that Constraint and Value Judgement are the most informative dimensions, with their combination achieving comparable or better performance than the full four-dimensional feature set across multiple models.
Critical strengths
A targeted benchmark for moral coercion detection. The paper introduces COERCION, a dataset of 4,700 multi-turn dialogues annotated with both binary coercion labels and six-level intensity scores. Unlike existing datasets primarily focused on explicit toxicity or general emotion recognition, this benchmark addresses the underexplored problem of implicit moral coercion, providing a useful resource for future research.
Systematic empirical evaluation and feature analysis. Through cross-domain comparisons, in-domain fine-tuning, and ablation studies, the paper demonstrates the benefits of task-specific training for moral coercion detection. In particular, Constraint and Value Judgement show relatively consistent contributions across different models, providing preliminary empirical insights into the linguistic mechanisms underlying moral coercion.
Critical weaknesses
Insufficient positioning against closely related methods. Although the paper discusses the MENTALMANIP dataset, it does not adequately engage with subsequent research on intent-aware and multi-stage prompting approaches for conversational manipulation detection. Without sufficient comparisons against these closely related methods, it remains unclear whether the proposed psychological dimensions offer meaningful methodological advances beyond existing structured prompting strategies.
Concerns about dataset reliability and submission compliance. The paper uses GPT-4o to generate synthetic dialogue examples but does not clearly report their proportion in the dataset or provide sufficient validation on independent real-world dialogues. This raises concerns about dataset representativeness and the generalizability of the experimental findings. Additionally, the paper omits the mandatory AI Use Statement required by ICLR 2027, despite explicitly using generative AI, constituting a violation of the conference's disclosure requirements.
Questions for authors
Could the authors clarify what methodological advantages the proposed dimension-aware pipeline offers over existing approaches that explicitly model conversational intent or intermediate reasoning signals for manipulation detection? In particular, what evidence demonstrates that the proposed psychological dimensions provide benefits beyond those achievable through existing structured prompting strategies?