- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies post-hoc rank reduction of trained LoRA-RL reasoning adapters without retraining. It selects paired LoRA coordinates using checkpoint-derived scores and evaluates the reduced adapters on three mathematical reasoning benchmarks. The results show substantial but task-dependent redundancy, while additional analyses suggest that coordinate importance depends on the stored factorization. A DoRA experiment provides limited evidence of transfer to another adapter type.
Critical strengths
-
The proposed post-hoc reduction retains most of the original performance after removing up to 50% of the LoRA parameters, demonstrating meaningful redundancy in trained reasoning adapters.
-
The paper explicitly distinguishes factorization-specific coordinate selection from intrinsic coordinate importance and reports validity checks designed to test this distinction.
Critical weaknesses
The effectiveness of the proposed method is not convincingly demonstrated. The coordinate-scoring method does not consistently outperform random selection or SVD, and the paper’s own analysis shows that the scores do not reliably reflect the actual contribution of individual coordinates. Therefore, the experiments mainly demonstrate redundancy in LoRA adapters rather than the effectiveness of the proposed selection method.
Questions for authors
-
Can the authors clarify when and why the proposed scoring method performs better than random selection or SVD? Is the improvement statistically significant in any setting?
-
Do the LoRA and DoRA experiments use the same DeepSeek-R1-Distill-Qwen-1.5B backbone? If so, what evidence suggests that the findings generalize to other model sizes or model families?
2 comments
Thank you for the careful and transparent clarification. The response confirms that the advantage of Energy over Random or SVD is mixed and not statistically established, while the DoRA experiment does not demonstrate generalization across model sizes or families. These remain central concerns regarding the proposed selection method, so I maintain my current rating.
Response to Reviewer oFk4
Thank you for asking when Energy performs better than Random or SVD, and whether the observed differences support a statistical claim. We also clarify what the DoRA comparison does and does not establish about backbone generalization.
Question 1: Can the authors clarify when and why the proposed scoring method performs better than random selection or SVD? Is the improvement statistically significant in any setting?
On AMC23 at r20, with Random coordinate-subset seed 42, Energy scores 25/40 versus Random's 23/40 at generation base seed 47 (+5.0 percentage points) and 28/40 versus 25/40 at seed 89 (+7.5 points; Supplement Table 16). Against SVD-DeltaW at r20, Energy scores 28/40 versus 25/40, but only 20/40 Energy--SVD question pairs have verified matching physical-GPU provenance (Supplement Table 17). It does not lead at seed 23 (25/40 versus 26/40), and the fixed-generation-seed comparisons in Supplement Table 15 are mixed: four Energy wins, one tie, and one loss across the six r16/r20 comparisons.
Energy measures the magnitudes of the stored, unscaled rank-one terms; it does not measure their marginal accuracy contributions, so the observed differences do not establish a mechanism. The reported values are per-question paired observed differences. Statistical significance has not been established. The archived bootstrap intervals cannot be exactly reproduced because the original bootstrap implementation is not bound to the available files. These point estimates are descriptive.
Question 2: Do the LoRA and DoRA experiments use the same DeepSeek-R1-Distill-Qwen-1.5B backbone? If so, what evidence suggests that the findings generalize to other model sizes or model families?
The archived LoRA and DoRA configurations identify the same named DeepSeek-R1-Distill-Qwen-1.5B backbone. The DoRA evaluation contract records base-file fingerprints matching the recovered base-model manifest, but the available records do not fully bind that immutable base-weight version to the original M1 LoRA training invocation. The DoRA experiment tests another adapter parameterization on the recorded named backbone; it does not establish generalization to other model sizes or model families, and the independent training runs do not isolate a causal adapter-parameterization effect. See main-text Section 4.5 and Table 3, and Supplement Section J.1 and Table 14 for the DoRA protocol and results.