- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper introduces HALLMARK, a benchmark of 2,526 citations covering 14 types of citation hallucinations, and evaluates different LLMs and database-based verifiers. The paper has a detailed error taxonomy and extensive experiments, with useful findings on false positives, particularly when verifying recent papers or using external tools. However, the motivation for the benchmark is weak, since most of the errors involve bibliographic metadata that can be verified using existing databases. The paper also lacks a strong, independent metadata-matching baseline to justify the use of LLMs for this task. It excludes citation faithfulness, which limits its ability to detect citations that are correct but do not actually support the claims being made.
Critical strengths
-
The benchmark covers 14 types of citation errors and includes six diagnostic checks, allowing a detailed analysis of which errors different verifiers can detect.
-
The paper provides extensive experiments across different LLMs and verification methods. Its analysis of false positives, especially for recent papers and tool-augmented models, offers useful insights into the reliability of citation verifiers.
Critical weaknesses
-
The motivation for the benchmark is very weak, as most of the citation errors involve bibliographic metadata that can be verified through existing databases. The paper does not clearly explain why LLMs are needed for this task. The use of LLMs as verifiers is understandable when checking whether the citation supports the claim, and this setting is explicitly excluded from the benchmark's scope.
-
The paper lacks the main baseline of database lookup and metadata-matching. The DOI-only baseline is too limited to establish whether LLMs offer any advantage over conventional verification methods.
-
Most hallucinated citations are synthetically generated by modifying existing references. This raises concerns about how well the benchmark reflects citation errors encountered in real scientific papers.
-
The best-performing verifier, bibtex-updater, was developed alongside the benchmark taxonomy. This makes it difficult to judge whether its performance and the cascade results would generalize to other datasets.
-
The benchmark excludes citation faithfulness, so it cannot identify citations that refer to real papers but fail to support the claims being made. This limits its usefulness for detecting misleading citations in scientific writing.
Questions for authors
-
Can the authors evaluate a stronger independent baseline using bibliographic database lookups and metadata matching instead of relying on DOI-only verification?
-
What specific citation errors in HALLMARK require LLM-based reasoning, and what advantages do LLM verifiers offer over conventional metadata verification?
-
How well do the results on synthetically generated hallucinations reflect verifier performance on errors found in actual scientific papers?
4 comments
Response to Reviewer ZMwx (2/2)
Baseline of database lookup and metadata matching (W2/Q1)
The reviewer asks for a stronger independent baseline than DOI-only verification. We ran two independent lookup tools without an LLM and two with one (general response, Table 1). None of these tools shares authors with us.
- Lookup only. RefGuard (Crossref, DataCite, Open Library) reaches recall 0.530 at FPR 0.258. reference-audit without its LLM step (DBLP, Semantic Scholar and others) reaches 0.217 at 0.070. DOI-only reaches 0.110 at 0.000.
- Lookup plus LLM. reference-audit with its LLM step reaches 0.930 at 0.013. VerusCite, which sends what Crossref cannot confirm to a web-search agent, reaches 0.814 at 0.010.
- What this shows. Independent lookup tools either miss most errors (reference-audit, recall 0.217) or flag a quarter of valid references (RefGuard, FPR 0.258). With an LLM step, independent pipelines reach recall 0.814 to 0.930 at FPR 0.010 to 0.013, so LLMs improve on conventional verification on both counts (W1/Q2).
Synthetically generated hallucinations (W3/Q3)
The reviewer asks how well results on synthetically generated hallucinations reflect errors in actual scientific papers. Most of our synthetic hallucinations reproduce error types documented in real incidents. Furthermore, to check results on actual errors, the paper already evaluates on authentic ChatGPT citations, and we now add 932 real errors as a new split and evaluate on 2,030 citations from real papers (general response, Table 2).
- Synthetic entries follow documented error types. Our taxonomy is based on real incidents, as 63JQ also notes. 11 of the 14 types are derived from documented incidents, and they cover about 80% of the hallucinated entries on the public splits. The other 3 are stress-test types. Of the 72 real-world hallucinated citations we analyzed in detail, 79% map to a single type (Sec. 3.1, App. A.2).
- Results on real errors match HALLMARK. On a new evaluation-only split of 932 hallucinated citations found in published papers (recall only), the lookup tools rank in the same order as on HALLMARK: bibtex-updater 0.924 (0.835 on HALLMARK), RefGuard 0.591 (0.530), reference-audit without LLM 0.113 (0.217), DOI-only 0.089 (0.110). On 341 authentic ChatGPT citations hand-verified by Walters and Wilder, which also include valid entries (App. C.6), the FPR ordering of four LLM verifiers on HALLMARK is preserved (0.029 to 0.860 here), and bibtex-updater reaches recall 0.929 at FPR 0.076 (0.820 at 0.038 on the HALLMARK dev split).
- 2,030 citations from real papers across fields. On VerusCite V1 (general response, Table 2), lookup tools flag more valid citations outside the ML domain (FPR 0.192 to 0.314), mostly because of differences in citation style (W1/Q2).
Co-design and generalization (W4)
- Independent tools on HALLMARK. Two independent pipelines with an LLM step reach lower FPR than our cascade (VerusCite 0.010, reference-audit 0.013, vs. 0.027), so the two-stage design works without our tools.
- Other datasets. bibtex-updater keeps the highest recall on real errors (0.924), but its FPR rises on non-ML citations (W3/Q3 above).
- Another Stage 1. Swapping our Stage 1 for reference-audit lowers the cascade to 0.751 at FPR 0.171, so the cascade's accuracy depends on the Stage 1 tool.
Citation faithfulness (W5)
We agree that HALLMARK does not test whether a cited paper supports the claim it is cited for. We focus on the earlier step for two reasons. First, a faithfulness checker must retrieve the right paper before it can read it, so an error in this step will affect every later check. Second, this step is not solved, and venues already depend on it. Lookup tools' performance still diverges (W1/Q2), and venues now screen submissions with such tools before human review. They also have no shared definition of a hallucinated citation, yet several have desk-rejected papers for it. Of the eight venues we checked, only two define the term operationally, and their definitions differ. The verifier ranking changes with the definition (App. H.1). However, claim support is an important next step and we now list it as future work.
Thank you for the detailed responses. The additional experiments address most of my experimental concerns. However, I remain concerned about the benchmark's limited scope, as verifying bibliographic metadata alone cannot determine whether a citation supports the claim being made. The practical value of evaluating citation correctness in isolation from citation faithfulness remains insufficiently justified, which continues to affect my overall assessment.
Thank you for engaging with our response, and we are glad the additional experiments address most of your experimental concerns. We agree that citation faithfulness matters. Our Summary of the Discussion above explains why we evaluate citation correctness first, and we list claim support as future work.
Response to Reviewer ZMwx (1/2)
We thank the reviewer for their acknowledgement of our work as a fine-grained benchmark with extensive experiments, and for their detailed feedback. We made the following changes to our submission (we detail our responses below):
Summary:
Why LLMs are needed (W1/Q2)
The reviewer asks which citation errors require LLM-based reasoning. We agree that lookup alone can catch hallucinated papers (e.g., bibtex-updater, with no LLM, flags all 214 papers that do not exist). In practice, though, lookup tools range from 0.110 to 0.835 recall and from 0.000 to 0.258 FPR on HALLMARK (general response, Table 1). Therefore, whether a database can resolve a citation depends on the tool. Lookup fails in two areas, both of which are addressed by an LLM step.
Table 1. Recall on the public test split.
Paper does not exist: invented DOI, placeholder authors, a title spliced from several papers, fields merged from two papers, a real DOI with another paper's fields, or a realistic invented paper. Nonexistent venue: the venue does not exist. Other: a future year, missing or swapped authors, a wrong arXiv version, or a real title with small edits. All 14 types are in App. A.1 (Table 2).
Without its LLM step, reference-audit leaves many entries undecided and we count these as not flagged. Our cascade shows the same pattern as reference-audit: the LLM step adds most on single-field types (wrong venue 0.71 to 0.86). It loses some recall on papers that do not exist (1.00 to 0.85) because its LLM step answers "uncertain" on 32 of them, which we count as not flagged.