- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper seems to suggest a method for model merging. Unfortunately, despite a giving an earnest attempt at understanding this paper, I could not make sense of it.
Critical strengths
None
Critical weaknesses
The authors mentioned that LLMs were used to help with the writing process. Perhaps too much of the paper seems to be written by LLMs? I really could not make heads or tails of this paper.
For example, I already don’t understand the first line of the main technical section:
“For two fine-tuned models with weights , write for the loss along the interpolation, under a specified dataset, metric, and data split. Change any of those choices and the object changes, so we treat a path as an evaluation-conditioned function, not an intrinsic property of two checkpoints”.
All I understood is that you define L to be the loss of the convex combination of two models. What does the additional commentary mean? I am similarly confused by every sentence I read.
I’m sorry I could not provide a more substantive’s review especially regarding the contents of the paper.
Questions for authors
Beyond majorly rewriting the paper, I do not have any suggestions for the authors.