- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies knowledge conflict in domain-adapted language models, focusing on cases where a model continues to produce stable predictions that disagree with the correct domain-specific answer after supervised fine-tuning. The proposed method, CIDA, assigns a continuous conflict score based on agreement across multiple generations and disagreement with the target answer. It generates intended answer-preserving rewrites conditioned on the target answer and retrieved domain evidence, filters the rewrites for quality, and trains jointly on the original and rewritten questions. A KL-based invariance loss encourages the model to produce similar output distributions for each pair.
The experiments cover four QA datasets and three 7B to 8B language models, all adapted using LoRA. CIDA consistently outperforms vanilla fine-tuning in the main experiments, with the largest gains on examples classified as high-conflict. The ablations indicate that these gains cannot be attributed solely to additional training examples or optimization steps. They also provide evidence that grounded rewriting and the invariance objective make separate contributions.
CIDA performs worse than vanilla fine-tuning on multi-hop and temporal QA. These results suggest that the method depends on whether the rewrite preserves both the original answer and the reasoning conditions needed to derive it.
Critical strengths
Stable target disagreement after domain fine-tuning
This paper addresses an important failure mode in domain adaptation. A model may produce stable and plausible answers based on pretrained knowledge even when those answers conflict with domain-specific ground truth. Such errors are especially relevant in settings where organization-specific rules, terminology, or conventions differ systematically from general knowledge. Distinguishing stable conflicting predictions from unstable errors provides a useful basis for targeted intervention instead of treating all errors in the same way.
Coherent conflict-targeted intervention
CIDA uses the conflict score for three linked decisions: selecting examples for rewriting, downweighting the original, and upweighting the retained rewrite. Rather than discarding high-conflict samples, it converts them into additional supervision through domain-grounded, answer-preserving rewrites. This method then encourages agreement between predictions for the original and rewritten questions, and combines data augmentation with an explicit constraint on model behavior.
Empirical improvements aligned with the intended mechanism
The empirical results are consistent with the intended purpose of the method. Improvements are concentrated on high-conflict examples, while performance on low-conflict examples changes little. This pattern suggests that CIDA is addressing the targeted failure mode rather than merely improving average task performance. The ablations further indicate that the gains are not explained only by additional data or optimization steps, and that both grounded rewriting and the invariance loss contribute to the result.
Critical weaknesses
The evidence does not support a broad claim of general knowledge conflict resolution
The experiments are limited to LoRA-based adaptation of 7B to 8B decoder-only models and primarily involve single-fact QA tasks for which answer-preserving rewriting is comparatively feasible. By contrast, performance drops on multi-hop and temporal QA. These negative results expose an assumption of CIDA: the rewritten question must preserve the answer and all reasoning-relevant conditions. The results therefore support a narrower claim than the paper may appear to make. CIDA is effective for the evaluated answer-preserving domain QA settings, but its applicability to tasks involving compositional reasoning, temporal conditions, or answer-changing semantic details remains unestablished.
The reliability and interpretation of the conflict-detection and rewriting pipeline
The conflict score is estimated from only three generations and depends on fixed choices of temperatures, sentence-embedding model, similarity function, and thresholds. The score operationalizes stable disagreement with the target; it does not independently establish that the disagreement is caused by pretrained general knowledge rather than another systematic error. The rewrite filters rely largely on embedding-based proxies, which cannot guarantee that the answer, entities, numerical constraints, temporal conditions, or reasoning structure remain unchanged. The independent answer-recovery and literal-overlap audits help address direct answer leakage, but they do not directly verify semantic or reasoning-condition preservation. The results on HotpotQA and TimeQA indicate that violations of the preservation assumption can have a substantial effect.
All experiments use LoRA. Although the CIDA objective is not formally tied to a particular parameterization, the experiments do not establish whether its gains extend to full fine-tuning or other PEFT methods. The observed improvements may reflect a general benefit of conflict-aware training, an interaction with LoRA's low-rank update constraint, or a combination of the two.
Questions for authors
Scope, answer preservation, and the negative results:
Is the intended scope of CIDA limited to tasks for which answer preservation can be reliably established? Please report a human or independent semantic audit of whether the rewrites preserve the answer and all answer-determining conditions, with separate results for negation, numerical values, temporal expressions, named entities, and conditional or multi-hop questions. For HotpotQA and TimeQA, can the authors disentangle rewrite errors, retrieval quality, conflict-sample selection, sample weighting, and the invariance loss, for example by evaluating CIDA only on independently verified answer-preserving pairs?
Conflict-score validity, sensitivity, and dataset-level effects:
How stable are the selected high-conflict examples under changes to the number of generations, decoding temperatures, sentence encoder, similarity threshold, and random seed? As the score measures stable target disagreement rather than directly identifying a pretrained-knowledge cause, can the authors validate that high-scoring cases actually reflect conflicts with parametric knowledge? Please test whether downstream gains are associated with conflict prevalence after accounting for dataset size, answer format, retrieval quality, and rewrite acceptance rate.
Generalization across adaptation and rewrite mechanisms:
Does CIDA provide comparable gains under full fine-tuning or another PEFT method, and when the rewrites are generated by a different language model or written by humans? Please report whether the gain remains under full fine-tuning and with rewrites produced by a different model. As the paper explicitly states that full KnowTuning requires a reference model and an external domain knowledge base unavailable for CreditQA, please clarify the practical resource gap and avoid interpreting the KnowTuning-Lite comparison as evidence of superiority over full KnowTuning.
Thanks for the response
The clarification is appreciated. After reading reviews from other fellow reviewers, I tend to keep my negative rating.