- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the behavior of large language models under procedural knowledge conflicts, namely whether models still rely on their internal priors when the SQL or Pandas operator definitions provided in context differ from those learned during pre-training. The authors distinguish between abstract knowledge and surface-form knowledge, and refer to the undesirable over-reliance on internal knowledge as "prior leakage." Two benchmark datasets are constructed by redefining or renaming code operators, and models are evaluated under several prompting conditions based on both their generated answers and code. The experiments show that external documentation and explicit instructions can encourage models to use the new knowledge, but most models still fail to fully override their internal priors.
Critical strengths
- The paper focuses on procedural knowledge conflict rather than the more commonly studied factual entity conflict, which gives the topic some novelty.
- The controlled setup, based on redefining or renaming code operators, directly tests the degree to which models follow contextual knowledge.
- Beyond final answers, the paper introduces metrics based on token probability distributions to measure the relative use of internal and external knowledge, providing a more fine-grained analytical perspective.
Critical weaknesses
- The evaluation tasks are centered on relatively simple single-step aggregation operations, so the task complexity and domain coverage are limited, making it unclear how far the conclusions generalize to more realistic and complex procedural knowledge settings.
- The correspondence between the proposed metrics and final model behavior is not sufficiently validated, and interpreting knowledge sources solely from token probability changes risks confounding effects.
- The unlearning and controlled training experiments are weak and admit multiple interpretations, so they do not strongly support the paper's claims about the causes or mitigation of prior leakage.
Questions for authors
- Can the authors clarify whether the observed conclusions hold in more complex multi-step program synthesis, other programming languages, or other procedural knowledge domains?
- How do the authors rule out the possibility that token probability changes reflect linguistic preferences, formatting constraints, or positional effects rather than genuine differences between internal and external knowledge use?
- Given that the unlearning results admit multiple interpretations, how should successful forgetting be defined, and how can its causal relationship with changes in prior leakage be established more rigorously?
Summary of revisions
Hi reviewers, we have uploaded the revised PDF based on questions discussed here. The revisions adds the following (see new text in red in the pdf):
You can find details in our replies to each reviewer.