- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
Based on what I understand; this paper proposes a Fisher-based method for data selection because there is constraint on the resources and authors use this method for continual pre-training of large language models. For each candidate gradient, they have two different views; an anchor component for high Fisher directions and a frontier component for low Fisher directions. Authors also have a log-determinant objective and Sieve-Streaming for selecting diverse training examples. They tested their idea on TinyLlama-1.1B and Llama-3.1-8B on medical data and showed by using this method we can achieve higher accuracy (or I should say plasticity for learning) while forgetting the previous information less.
Critical strengths
- The idea of balancing plasticity (learning new things) and catastrophic forgetting (forgetting previously learnt data) is very interesting and tricky. Moving the Pareto front in this problems is very difficult and based on my own experience once we improve one aspect; the other one start to fail. This paper method looks like have handled both aspects at the same time.
- Other thing that I like about this paper is how they handled which documents they want to select and using log-determinant for assign a larger credit to documents that has a high value but also are not repetitive.
Critical weaknesses
- I can see the authors maximize a log-determinant objective for data selection. However, the anchor term rewards gradients in high-Fisher directions, which the paper says are important for retaining previous knowledge. I do not understand why maximizing this term should reduce forgetting instead of increasing interference with previous knowledge. Also I am concerned about the bounds of this loss.
- The evaluation is very limited. The models are limited, but the bigger problem is that the authors only test adaptation to one target domain (medical), not a sequence of domains. The reason I am concerned about this is because the loss of plasticity usually starts to happen and grows as the number of tasks grows, and we may not see this when we test our methods on a limited number of tasks. Even vanilla learning methods in networks can learn new things without losing plasticity for a few tasks; so I cannot be assured that the effect of frontier is real in a longer continual learning setup.
Questions for authors
- Based on the first critical weakness, can you please explain the intuition behind maximizing the anchor term? How does maximizing gradients in high-Fisher directions help reduce forgetting instead of increasing interference with previous knowledge? Do you have any proof for the bounds of this loss? Can it lead to instability because of maximization?
- Based on the second critical weakness, can you please test on a higher number of sequential tasks or domains and compare the baseline with anchor and frontier cases to see how they perform over multiple adaptation stages? You do not need to do a long and large experiment; you can use a smaller language model with several sequential text domains.