- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper aims to merge different specialist LoRA modules into a unified model. Specifically, it selects a reference module and donor modules, and merges the donors into the reference using a joint residual subspace, magnitude-weighted voting, and support-guided injection. Table 1 presents the primary results supporting this merging algorithm, showing slightly better performance than several merging baselines.
Critical strengths
Merging different capability modules into a single checkpoint for embodied reasoning tasks is a promising direction.
The experiments cover different baselines and settings, including different choices of reference modules in Table 2, and are generally comprehensive.
Critical weaknesses
The introduction does not clearly explain the specific challenges addressed by this method or its practical value beyond existing model-merging approaches.
The differences between the proposed method and the baselines are unclear, as several components substantially overlap with Task Arithmetic, TIES, KnOTS, and Core Space. In addition, Twin-Merging appears to be related but is neither cited nor discussed. The author should describe the difference and extension more clearly.
The experiments do not sufficiently support claims about broader embodied capabilities, as they mainly evaluate spatial reasoning, localization, and video understanding. Merging modules for tactile sensing, robot action learning, and additional perception capabilities would be more important for demonstrating broader embodied capabilities.
The performance gains over the merging baselines, specialist models, and joint training appear relatively small. It would be helpful to explain the practical benefits of this work in more detail.
It would be better to discuss the limitations and possible extensions more explicitly in a dedicated paragraph in the main text.
Questions for authors
Please see the weaknesses above for details.
I am curious whether this approach could be applied to improve multi-task training by making updates more consistent, and whether it could also benefit model pruning.
Is there a theoretical upper bound on the performance of this method?