- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies the continual adaptation capability of language models. The problem is potentially important, and the later sections appear to contain substantial experiments. Nevertheless, the introduction is hard to comprehend. The target problem is not well-specified, the limitations of and relationships with existing literature remain unclear, and numerous critical terms and symbols appear without definition. These issues prevent readers from proceeding to subsequent sections and assessing the paper’s technical contributions.
Critical strengths
The studied problem has practical significance.
Critical weaknesses
- The background information for the continual adaptation of language models is missing, which makes it hard for readers to understand the importance of this study. Also, the core problem studied in this paper is not sufficiently motivated. The narrative logic in introduction is confusing with many terms and symbols used without definition, e.g., coordinate, .
- The limitations of existing methods are insufficiently discussed, particularly those of the closely related FiUni. It is unclear under what circumstances or in which applications the second-order criterion would fail, apart from theoretically constructed transitions with matched moments. In addition, the related methods are organized without a clear internal logic, which makes it very difficult to follow.
- It is unclear how the proposed study addresses the problem stated in the introduction. As a result, the introduction does not provide valid evidence in support of the claimed contributions.
Questions for authors
- What is the core issue this study focuses on? Why is it important?
- Why do existing methods fail to address this issue in principle? What are the challenges?
- How does this work address these challenges in general? What innovations can this work bring to the research community to address the investigated problem?