- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
To the best I can tell, the authors propose a method for comparing a base model to a post-trained variant, based on behavioral properties of lesioning different components.
Critical strengths
None
Critical weaknesses
Unfortunately, I think this article should be desk rejected. I found the paper, especially sections 2-3, to be unreadable, which due to its over-formalization seems like LLM generated text to me.
Questions for authors
None
2 comments
Gentle Reminder
Dear Reviewer,
We would like to kindly follow up on our response. We have revised Sections 2–4 to improve readability and clarify the motivation behind our formalism, including intuitive definitions, a conceptual roadmap, simplified formulations, and controlled examples illustrating why the formal distinctions are necessary.
We would greatly appreciate it if you could review these revisions and let us know whether they address your concerns. In particular, we would welcome specific examples of remaining unnecessary formalism or passages raising concerns about LLM authorship, so we can address them more precisely during the discussion period.
Thank you again for your time and consideration.
Response to Reviewer FVfE
Thank you for raising the readability concerns. We agree that the presentation, particularly in Sections 2–3, could better motivate the formalism, and we have revised the manuscript accordingly.
In the revised paper, we (1) add intuitive definitions and references for key terminology in the Introduction, (2) add a conceptual roadmap and simplified intervention formulations in Section 2, (3) explicitly connect each formal distinction to failures of simpler alternatives in Section 3, and (4) clarify experimental motivations and interpretations in Section 4.
Nevertheless, while the presentation needed clarification, we maintain that the formalism serves necessary conceptual distinctions: signed roles distinguish opposing behavioral effects (Fig 2.); role and amount separate what a component does from how much it contributes; and capacity-constrained partial coupling accommodates splitting, merging, and unmatched function without over-claiming target mass (Section 3.2; Appendix D.3). Section 3 demonstrates the necessity of these distinctions through controlled constructions.
Regarding the concern about LLM-generated text, the conceptual framework, definitions, and mathematical formulations were developed by us; AI tools were used to polish the writing as stated in AI use statement. We would appreciate specific examples of unnecessary formalism or passages supporting the concern about LLM authorship, so we can address them precisely.