- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes C³-NER, a training-free framework for Chinese legal NER that integrates character-pattern retrieval, copy-preserving annotation, and contrastive guidance. Experiments on four NER benchmarks demonstrate improvements over existing methods on CAIL2021 and MSRA, supported by ablation studies and inference-cost comparisons.
Critical strengths
-
The proposed framework combines retrieval, source-preserving annotation, and type disambiguation without requiring model fine-tuning.
-
The method achieves competitive performance across multiple benchmarks and LLM backbones while reducing LLM calls and token consumption compared with existing methods.
Critical weaknesses
-
The experimental evaluation is limited in scope. Only one legal NER benchmark is evaluated, while the other datasets use subsets of just 200 samples. Moreover, the proposed method underperforms DEER on CLUENER2020 and OntoNotes, raising concerns about its generalizability.
-
The proposed framework relies on labeled training data to construct its Pattern Bank and manually defined confusion groups. However, the paper does not investigate sensitivity to the amount of available labeled data or the selection of confusion groups. This limits the evidence for its effectiveness in genuinely low-resource settings.
Questions for authors
-
Can the authors provide results on the full benchmark test sets or report performance variance across different evaluation subsets to demonstrate the robustness of the reported improvements?
-
How does performance change when the amount of labeled data available for demonstration retrieval and Pattern Bank construction is reduced?
-
How are the confusion groups selected?