- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper focuses on depth-dependent heterogeneity in visual LoRA adaptation for source-free cross-domain few-shot learning. It proposes counterfactual QK/V interventions to characterize layer contributions and projection sensitivities, and uses the resulting profiles to construct a sparse LoRA fine-tuning layout. The proposed method reduces trainable parameters and adaptation time while largely preserving classification accuracy.
Critical strengths
-
The study of improving efficiency of fine-tuning visual models via LoRA adaptation is meaningful.
-
The counterfactual analysis offers a useful perspective on projection-specific adaptation effects.
Critical weaknesses
-
The connection between intervention sensitivity and optimal adaptation placement is insufficiently established. The proposed diagnostics measure the effect of reverting individual LoRA components in a fully adapted model, but these effects do not necessarily reflect the importance of these components during retraining. The current experiments validate a particular sparse configuration without sufficiently establishing that the proposed functional measurements reliably identify optimal placements.
-
The claimed functional specialization is stronger than the supporting evidence. The QK/V sensitivity scores are intervention-dependent operational measurements. They do not directly establish stable or intrinsic computational roles. Moreover, a larger QK contribution does not imply that the V adaptation is dispensable.
-
The methodological novelty is limited relative to existing selective adaptation and pruning approaches. The proposed method ultimately instantiates a fixed, manually specified LoRA layout. Its advantage over simpler depth-based pruning, projection-specific adaptation, and importance-based selection methods is not fully supported.
Questions for authors
Please refer to Weakness.
Thank you for the response and revisions. I acknowledge that the authors have clarified some of my original concerns, especially the figures and experimental details. However, my main concern about the novelty and significance of this work remains.
The core idea is still very similar to previous importance-based LoRA methods. For example, AdaLoRA and LoRA-drop already study how to allocate or retain LoRA components based on their importance. I have also checked the revised Related Work, but I still do not think the authors properly position their contribution against these methods. The authors mainly explain how their importance measurement differs technically, without explaining what limitations of previous methods they address or what significant new insights their approach provides.
More importantly, why are these methods not included in the experiments? The authors compare with different ranks and random placements, but not with existing importance-based LoRA methods. Without direct comparisons under similar parameter budgets, it is difficult to judge whether the proposed method actually brings meaningful improvements.
The presentation is still difficult to follow. The paper contains too many statistical details and confidence intervals in the main text without clearly explaining what readers should learn from them. Even Table 3 reports unnecessarily precise parameter counts, making the results harder to read. Overall, the writing feels AI generated, as if the manuscript has not been carefully reviewed and polished by the authors.
Overall, while the revisions improve some details, I am still not convinced that the paper provides sufficiently new insights or significant improvements over previous works. Therefore, I maintain my rejection recommendation.