- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
KnowledgeMap identifies concept-level knowledge deficiencies behind LLM inconsistency via three components: a Knowledge Extractor (lexical concepts with importance weights), a Knowledge Checker (answer consistency under knowledge-invariant perturbations), and a Knowledge Updater (per-concept proficiency scores). Experiments on ConflictBank and TriviaQA (>200K samples; LLaMA-3.1-8B, Qwen2.5-7B-Instruct, Mistral-7B) show that more popular knowledge (Wikipedia pageviews as proxy) correlates with higher consistency, more concepts per question lowers consistency, and low-proficiency concepts yield lower average consistency. The framework moves beyond measuring inconsistency toward identifying the concepts behind it, offering actionable guidance for targeted knowledge enhancement, though whether proficiency scores capture genuine knowledge deficiencies versus perturbation sensitivity or confounders requires further validation.
Critical strengths
-
The paper addresses a well-motivated gap by moving beyond measuring LLM inconsistency toward identifying the concepts associated with unreliable outputs.
-
KnowledgeMap offers a modular, interpretable framework that cleanly separates concept extraction, perturbation-based consistency evaluation, and proficiency updating.
-
Large-scale experiments (>200K samples, two datasets, three LLMs) plus attention to reproducibility and robustness support the empirical findings.
Critical weaknesses
-
The central concept-level attribution claim is insufficiently validated, since sample-level consistency scores are assigned to all concepts in a question without distinguishing which concept, interaction, or reasoning error actually caused the failure.
-
The proficiency score relies on unverified assumptions, notably mapping F-T and F-F to the same value and equating perturbation consistency with knowledge mastery.
-
The experimental validation is largely indirect and correlational, resting on Wikipedia pageviews as a proxy and on associations that may be confounded by question difficulty, entity type, and answer ambiguity.
-
The contribution over existing perturbation-based evaluation is not isolated, as no systematic baselines or ablations show that the Knowledge Updater and its extra parameters are necessary.
-
The perturbation design may introduce confounds such as format sensitivity, instruction following, and contextual interference, so it is unclear that perturbations isolate knowledge-related inconsistency.
-
Evidence for practical utility is incomplete, since downstream benefits such as targeted fine-tuning are proposed rather than demonstrated against random or popularity-based selection.
-
Generalizability is limited to three small open-source models and two Wikipedia-linked factual QA datasets, leaving larger models, non-Wikipedia knowledge, conversation, and multi-step reasoning unaddressed.
Questions for authors
N/A