Paper's own ablations do not support its main story of "stabilizing rank evidence" or "a budget-dependent crossover". Almost all of the accuracy gain comes from a standard final-phase cosine LR decay (Eq. 23), and paper does not state whether baselines used the same LR schedule.
W1. Accuracy gains come from a final-phase cosine LR decay, not from evidence stabilization (Tab. 2, Eq. 23).
- "Readout consolidation" (Eq. 23) is simply a cosine LR decay from 3e-4 to 3e-5 over the final phase (the SGDR schedule [R5]).
- In Tab. 2a, adding Taylor scoring, CV discount, Linear-module pooling, and minimum rank 1 to AdaLoRA gives 81.83-81.91 (below AdaLoRA's 82.01). By contrast, adding consolidation alone to AdaLoRA jumps to 82.48, and full SCALP gets 82.58. Thus, the cosine LR tail accounts for ~82% of SCALP's gain, while the stabilization rules add only +0.10 (within 3-seed noise).
- In Tab. 2b, adding orthogonality alone to SoRA lowers accuracy (80.58 vs 80.91). Adding consolidation alone jumps to 82.38, and full SAGE gets 82.55. So the cosine LR tail accounts for ~90% of SAGE's +1.64 pt gain.
- In SCALP, this LR decay runs after the rank mask is already frozen (p5 L257-259). This contradicts the core principle of stabilizing evidence "before it is committed" (p3 L151-153).
- Crucially, the AdaLoRA and SoRA rows in Tabs. 1 and 4 match the "no-consolidation" rows in Tab. 2, and paper never states the LR schedule used for any baseline. If baselines ran without a comparable LR decay, the reported margins may simply reflect the LR schedule rather than BARS-LoRA.
W2. The claimed budget crossover does not hold in Tab. 4.
At the 4-epoch endpoint where SCALP is claimed to overtake SAGE, the 4-task means are a statistical tie: SCALP gets 82.58±0.69, SoRA gets 82.48±0.53, and SAGE gets 82.32±0.20 (Welch p ~ 0.85 and 0.59, Tab. 4). In fact, SAGE has the highest mean at every uniform step budget (800, 1600, and 3000 steps), and SAGE at 1600 steps (83.75) beats every 4-epoch score. Also, the 4-epoch budget scales with dataset size (RTE gets only ~1200 steps, which is shorter than the 1600-step budget), so it is not a clean long-budget test.
W3. The testbed is insensitive to rank, and the claimed failure modes are not measured (Tabs. 3, 5, 6, Fig. 7).
- Across r∈{4,8,12,16}, tuned fixed-rank LoRA varies by only 0.31 pts at 4 epochs (where r=4 is best) and 0.56 pts at 800 steps (Tabs. 5-6). When rank barely affects accuracy, rank allocation has little room to help. Indeed, SCALP vs LoRA r=4 (+0.57, p ~ 0.31) and SAGE vs LoRA r=16 at 800 steps (+0.40, p ~ 0.18) are statistical ties.
- Paper never directly measures either diagnosed failure mode (mask turnover across pruning steps, or subspace drift of A,B in SoRA vs SAGE). Fig. 7 lacks a SoRA curve and averages gates across unaligned seeds, and SAGE's final active rank is not reported. Also, the 1.7B table (Tab. 3) omits SoRA and LoRA r=16.
W4. Most technical components come from prior work without full credit (Eqs. 10-13, 22, 23).
Eq. 10 follows directly from Euler's identity for multilinear forms and matches Molchanov et al. [R4, Eq. 9]. SCALP's importance score (Eq. 11) is the exact s(λ) term of AdaLoRA [R1]. The EMA mean and deviation trackers (Eqs. 12-13, with β=0.85) are identical to PLATON [R3] (uncited) and AdaLoRA [R1], and a mean-over-deviation rank score was also published in IGU-LoRA (ICLR 2026) [R6]. Eq. 22 is AdaLoRA's orthogonality regularizer (weight 0.1), which SoRA [R2] explicitly chose not to use. Finally, Eq. 23 is SGDR [R5]. The genuinely new parts (bounded CV discount and minimum rank 1) add only +0.04 and +0.05 in Tab. 2a.
References
[R1] Q. Zhang, M. Chen, A. Bukharin, et al. AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning. ICLR 2023. arXiv:2303.10512.
[R2] N. Ding, X. Lv, Q. Wang, et al. Sparse Low-rank Adaptation of Pre-trained Language Models. EMNLP 2023. arXiv:2311.11696.
[R3] Q. Zhang, S. Zuo, C. Liang, et al. PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance. ICML 2022. arXiv:2206.12562.
[R4] P. Molchanov, A. Mallya, S. Tyree, et al. Importance Estimation for Neural Network Pruning. CVPR 2019. arXiv:1906.10771.
[R5] I. Loshchilov, F. Hutter. SGDR: Stochastic Gradient Descent with Warm Restarts. ICLR 2017. arXiv:1608.03983.
[R6] X. Cui, H. Li, R. Zeng, et al. IGU-LoRA: Adaptive Rank Allocation via Integrated Gradients and Uncertainty-Aware Scoring. ICLR 2026. arXiv:2603.13792.
As authors didn't post any reply during the rebuttal period, I have no further updates.