- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper revisits generalization in knowledge editing through an analysis of non-identifiability and optimization effects. It further shows that models judged to overfit under conventional evaluation can still use edited facts in multi-hop conversations, motivating a compositional view of generalization.
Critical strengths
The paper raises a useful question about whether conventional evaluations reflect how edited models are used in practice. The observations across several models and editing methods suggest that this issue deserves further attention.
Critical weaknesses
- The main comparison changes both the input format and the scoring method. This makes it hard to tell how much of the observed difference comes from compositional generalization. A comparison under a common evaluation criterion would make the main conclusion more convincing.
- The theoretical discussion explains why fitting edited facts does not guarantee generalization, but its connection to the behavior observed in the experiments is still unclear. In particular, the assumptions about the model’s composition process are not sufficiently checked. The proposed paradigm shift therefore seems stronger than the current evidence supports.
Questions for authors
- Would the main conclusions still hold if both settings were evaluated using the same criterion?
- Which assumptions in Section 4.1 are supported by the experiments? It would help to clarify whether the required knowledge and composition ability remain intact after editing.
2 comments
W2 / Q2 - The Connection Between Theory and Experimental Behavior, and Whether the Evidence Is Sufficient to Warrant a Call for a Paradigm Shift
Thank you for raising this question. We will more clearly articulate in the paper the connection between the theoretical discussion and the experiments. This paper does not directly infer "models can exhibit compositional generalization in the in-the-wild setting" from "fitting edited facts does not guarantee generalization." Instead, we advance three interrelated claims. First, the old paradigm expects local fact-fitting to directly produce the target mapping on unseen compositional queries; however, unidentifiability renders this research objective theoretically under-constrained and thus difficult to achieve. Second, compositional generalization offers a theoretically grounded alternative path: newly edited facts can interact with the model's existing knowledge and compositional capabilities, making the desired generalization feasible under certain conditions—conditions that the old paradigm's mapping-based evaluation happens to preclude. Third, once we adopt a new setting that allows the model to more fully leverage its compositional capabilities, we do indeed observe this generalization behavior.
In the specific experimental setting, for a multi-hop query (s, r1, o1, r2, o2): the completeness of the first hop (s, r1, o1) is verified by the efficacy test; the compositional capability is evidenced by the edited model's ability to actually complete the reasoning chain; and the output pattern analysis in RQ4 further demonstrates that the model retains the ability to reason via chain-of-thought after editing. As for whether the second hop (o1, r2, o2) remains intact after editing, we conducted a supplementary experiment evaluating the second-hop factuality of Qwen3.5 before and after ROME and MEMIT editing. The results confirm that the second-hop knowledge does indeed remain intact:
| Model | Qwen3.5 (Unedited) | ROME | MEMIT |
|---|---|---|---|
| Second-Hop Factuality | 90.1 | 90.6 | 90.6 |
That said, we do not deny that the precise internal mechanism underlying the model's compositional generalization has not been—and is indeed difficult to—deeply explained. Research on compositional generalization in LLMs is itself a significant field in its own right, still at a very early stage, with the entire community remaining highly curious about the underlying mechanisms. Resolving a central open problem in another field is clearly beyond the scope of a position paper in the knowledge editing domain. Nevertheless, we emphasize that this does not undermine the support that the theoretical reasoning and the observed experimental phenomena provide for our claims. We already know that the old paradigm is theoretically difficult to realize and has stalled the editing field without substantive progress for years. Given this, why should compositional generalization—a theoretically grounded and empirically observed direction of generalization—be required to fully explain its internal mechanisms before it is worth calling for a paradigm shift? The insufficiency of mechanistic understanding should be one of the open problems that this new agenda calls upon the community to address; it is not a prerequisite that must be resolved before the agenda itself can be proposed.
Thank you for your thorough and careful review. We are pleased to see that you find the core research question of this paper interesting and worthy of further attention. We hope the following response will clarify your concerns about the paper.
W1 / Q1 - Changes in Input Format and Evaluation Paradigm
Thank you for raising this concern. We first want to point out that the argument of this paper does not require the two sets of results to be numerically comparable. Our core contribution is to argue a position: the prevailing direct-generalization setting and its evaluation protocol—which naturally encompasses many elements such as the input template and scoring method—is conceptually unsound and fails to reflect the model's actual generalization capability in practice. The old protocol evaluates generalization via teacher-forced scoring on plain-text fixed prefixes, judging generalization by the probability of answer tokens without ever asking the model to actually generate a response; real users do not interact with edited models this way. Our setting, by contrast, simulates how real users query models in conversation, allows the model to generate freely, and then evaluates whether the generated response is correct. Under this new setting, the scoring method naturally needs to change. The key insight is that while the old protocol yields a consensus that edited models cannot generalize, in-the-wild generation demonstrates that they actually can. This divergence highlights the inherent limitation of the old protocol, and proving this point does not require numerical comparability between the two sets of scores.