- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents a continual learning method for training LLMs. Similar to previous methods there method proposes to find a small set of parameters to update with new task data. They present based on importance estimation method based on Fisher information and using gradient and curvature information. Unlike previous methods that rely on past task data there method needs new task data to ensure continual learning
Critical strengths
- It's a continual learning method that shows improvement over existing SOTA methods.
- Unlike previous data, this only relies on new task data, making it more practical for use
- They show their improvements on both text LLMs and multimodal LLM families
- Exhaustive comparison with previous methods, and the datasets cover a lot of domains with consistent improvement across a lot of them.
Critical weaknesses
- Their method uses a similar idea to the Fish Mask paper (Sung et al. 2021), applied to parameter selection for an LLM. This is still an empirical contribution but with weaker novelty
- Prior methods like EWC penalize old task important parameters to prevent forgetting. The authors' method relies on new task data to find parameters for updating. This doesn't guarantee that previous tasks are not forgotten. The authors show, using the BWT score for general capability preservation, that their method is among one of the lowest. But the evidence is still insufficient to conclude it preserves general capability. And it seems replay still outperforms their method at times.
Questions for authors
- Could the authors provide a reason for 1 epoch of training for Qwen3-14B compared to other models?
- For Table 3, why did the authors select a narrow set of baselines? Even though their method is the lowest BWT, it is still generally higher, so I am curious whether it is still low compared to other baselines (replay, EWC, GEM, etc.)
- Can the authors clarify the relationship to the Fish Mask paper (Sung et al. 2021)? How does PIECE - F/S distinguish from it?