- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors propose a novel method for fine-tuning diffusion language models on narrative stories which requires fewer tokens than competing approaches for the model to perform well at downstream tasks requiring recalling relevant knowledge for question-answering. Essentially, this is a method for better knowledge injection/retainment.
Critical strengths
- Knowledge injection being data inefficient during fine-tuning is a big problem in AI. The authors propose a lightweight yet effective method to tackle this problem.
- Clear problem definition. The paper was also easy and enjoyable to read.
- Reasonable set of ablations to backup the design choices.
Critical weaknesses
- Fine-tuning results are only performed on a single model (Dream-v0-Instruct-7B). It would be interesting to see how the methods performs for different model families and sizes.
- Not clear how the proposed knowledge injection method degrades the instruction-tuning capabilities of the model.
Questions for authors
- Given you are fine-tuning a diffusion model, can the model then only be used for diffusion-based text generation? If so, then I feel like this should be made more clear in the intro, that the method only applies to such type of models.
- Have the authors tested and compared against other methods how their proposed approach affects instruction-tuning capabilities?
- Full parameter weight updates are performed. Is this because methods like LoRA perform poorly? Have the authors experimented with this?
- Why did you choose to report results at the final checkpoint rather then selecting the best checkpoint based on some validation set, and how did you determine the total amount of training?
- Line 37, "Previous studies have found that standard fine-tuning on the original corpus struggles to make newly learned knowledge reliably extractable," is this because of fine-tuning? How does having a given narrative story in the pre-training corpus versus fine-tuning affect that models capability to recall? The authors do not need to address this in the paper, I simply ask out of curiosity in case authors have expertise on this.
Comments
- Line 101: for contributions, authors could consider reducing the left margin of bullet points to save space. This might allow page two to start with section 2 rather than the last bullet point.