- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Med-PRISM, a replay-free continual learning framework for medical multimodal models. The method combines a shared LoRA adapter trained under a drift constraint with task-specific private LoRA adapters that are frozen after each stage and cumulatively activated at inference. The central contribution is a regularization mechanism called SAMC, which performs SVD on each frozen private update and uses the resulting spectral energy distribution to penalize new private updates more strongly along high-energy historical directions while leaving lower-energy directions more flexible. The authors also construct a five-task medical benchmark called MedicalSkill-CL and provide a theoretical bound on old-task loss drift.
Critical strengths
S1. The paper constructs MedicalSkill-CL, a five-task benchmark covering heterogeneous medical skills with different prediction formats, from classification to grounding to multi-image reasoning. The construction pipeline includes format harmonization, overlap checks, and stratified sampling, addressing a genuine gap in evaluating continual learning across diverse medical tasks.
S2. The theoretical analysis cleanly decomposes old-task loss drift into four interpretable terms and identifies the first-order interference component controlled by SAMC. The spectral diagnostics in Section 4.4 provide meaningful empirical evidence that the learned weighting behaves as the theory predicts.
Critical weaknesses
W1. The architecture lacks novelty. Equation 1 is simply the base weight plus a shared LoRA plus the sum of all private LoRA updates, essentially the same superposition as O-LoRA. SAMC merely replaces uniform orthogonality penalties with spectral-energy-weighted penalties, a straightforward extension of GPM and SGP that the paper itself acknowledges in Section 2.3. The two-point gain over the strongest baseline does not justify acceptance at a top venue.
W2. Scalability is unaddressed. Inference activates all historical private adapters without routing, so memory and computation grow linearly with tasks. Appendix F reports 53.7M retained parameters at stage 5, yet the paper evaluates only five tasks and discusses no merging, pruning, or bounded-memory mechanism.
Questions for authors
See the Critical Weaknesses.