- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies rehearsal-free continual VLA model merging, where new manipulation skills are sequentially adapted and consolidated into a shared vision-language backbone without replaying historical demonstrations. The proposed method retains historical activation subspaces and uses them to constrain subsequent LoRA adaptation through a soft orthogonal gradient constraint and a Subspace-L2 regularizer, while stage-specific action modules are preserved. The method achieves the best reported rehearsal-free performance among the compared methods.
Critical strengths
- Continual consolidation of VLA skills without retaining historical demonstrations is practical.
- The proposed method substantially improves both final performance and trajectory-level retention.
- Detailed storage accounting is reported rather than relying only on the final performance.
Critical weaknesses
-
Rehearsal-free continual learning, LoRA-based continual adaptation, and orthogonal-gradient protection are all well-established ideas. The main novelty lies in adapting and combining these mechanisms for continual VLA model merging rather than introducing a fundamentally new continual-learning principle.
-
Stage identity is required to select the corresponding stage-specific action module, while these modules are retained separately throughout continual learning. This limits realism for deployment where the relevant historical stage may be unknown.
-
The paper provides storage accounting but does not report training time, GPU hours, FLOPs, or the additional runtime.
-
The paper analyzes the merge coefficient, but does not systematically study important parameters such as the historical rank and the retained-energy threshold.
-
The cross-suite evaluation covers only three of the standard LIBERO suites (Spatial→Object→Goal), excluding LIBERO-Long. It is therefore unclear whether the observed retention advantage generalizes to longer-horizon and compositionally more complex tasks.
Questions for authors
See above.