- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work focuses on the well-known coverage-correction tradeoff in document-level event extraction (DEE), where efforts to expand candidate space and recover overlooked non-salient events frequently result in spurious candidates and structural conflicts between extracted events. The authors propose BALANCE-DEE, a structured refinement framework that uses discriminatively enhanced schemas to guide candidate generation, a two-factor eventness assessment to filter invalid candidates, and a learned action-gain function to evaluate insertion, deletion, and split-and-reallocation edits. Experiments across three datasets (FNDEE, CrudeOilNews, SENTiVENT) show consistent improvements in event recall, particularly for non-salient events, while reducing over-extracted arguments and cross-event argument attachment errors.
Critical strengths
Critical Strengths
1.The paper addresses an important practical tradeoff in document-level event extraction between recall and precision.
2.The experimental results on non-salient event detection show interesting trends that could inform future work.
Critical weaknesses
Critical Weaknesses
1.Fundamental evaluation flaws: The paper's evaluation uses an overly permissive event matching criterion that artificially inflates performance scores. The reported improvements do not hold when using standard evaluation metrics for event extraction.
2.Lack of novelty: The iterative correction approach is a straightforward combination of existing candidate generation and filtering techniques that have been explored in prior work on structured prediction refinement.
3.Limited practical utility: The proposed approach increases inference time by 300% compared to single-pass extractors, making it unsuitable for most real-world applications that require low-latency processing.
4.Unconvincing gain function design: The learned action-gain function lacks theoretical justification and shows high variance across different datasets, suggesting it may not generalize well.
Questions for authors
None
Response to Reviewer mPvW
Thank you for your careful review and constructive suggestions. We have conducted additional experiments to address the points raised, and the corresponding results and analyses will be incorporated into the revised manuscript.
Q1:
We agree with the reviewer's suggestion to further examine the robustness of the recall gains for non-salient events. Accordingly, we conducted an additional sensitivity analysis of the textual-salience threshold. Keeping the model predictions fixed, we repartitioned the events using the 40th, 50th, and 60th percentiles of the training-set salience scores.
Additional Experiment 1: Sensitivity of Event Recall to Textual-Salience Thresholds on FNDEE.
The results show that non-salient events consistently achieve larger recall gains across all three thresholds, confirming the robustness of this trend. Since this analysis relies on a textual-salience proxy, we will further clarify its definition and limitations in Appendix B.2. The additional sensitivity analysis will be included in Appendix A.8.
Q2:
The original submission analyzes the contributions of individual components on FNDEE and evaluates the full framework on three datasets. We agree with the reviewer that examining whether the component-level trends remain consistent across datasets with different languages and domains would provide stronger evidence for the effectiveness of the framework.
Additional Experiment 2: Cross-Dataset Stage-wise Ablation with a Fixed Candidate Pool.
We conducted additional stage-wise ablations on CrudeOilNews and SENTiVENT. All expanded configurations share the same candidate pool, allowing us to distinguish the contributions of candidate expansion, eventness verification, and structural correction. The results will be included in Table 7 of the revised manuscript.
Both datasets exhibit a consistent trend: candidate expansion improves recall but reduces F1 when used alone; eventness verification suppresses spurious candidates, while structural correction further improves the final extraction performance. These findings provide additional evidence that the contributions of individual components remain consistent across datasets.
Regarding methodological novelty, we understand the reviewer's concern about the incremental nature of the contribution. Prior work on document-level event extraction has largely addressed missed events, spurious events, and argument misassignment separately, making it difficult to balance the recall gains of candidate expansion against false-positive risks and structural conflicts. To address this limitation, our framework jointly considers candidate validity and state-conditioned action gain, allowing the recovery of missed events to trigger argument reallocation in existing records. Dynamic rescoring further enables iterative correction of multi-event structures.This design enables the joint correction of multiple interrelated error types in document-level event extraction. Experimental results demonstrate the effectiveness of the joint decision mechanism in reducing structural errors, as well as the necessity and synergistic contributions of its components.