- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies how to select layers for updating before reinforcement learning begins. Fulcrum measures the amplification of representation changes using the spectral norm of each layer’s downstream Jacobian. It then removes a linear depth trend and selects a contiguous interval of layers to train. Experiments on three Qwen3 model sizes show that updating ten layers approaches the average performance of full-parameter training while reducing memory use. The paper also includes single-layer training experiments, an ablation that freezes the selected interval, and experiments on SFT and SDXL.
Critical strengths
- Selecting trainable layers before RL is a useful problem. A reliable method could reduce the cost of both layer-by-layer trial runs and subsequent training.
- The reported performance and memory results are encouraging. Across three model sizes, training only ten layers retains most of the average improvement from full-parameter training. On Qwen3-8B, peak memory falls from 69.96 GB to 30.62 GB. The performance drop when the selected interval is frozen also provides some evidence that these layers matter.
Critical weaknesses
-
The paper lacks direct controls showing that Fulcrum is better than simple selection rules. There is no comparison with fixed middle intervals or random contiguous intervals under the same ten-layer budget and update scheme. This comparison is particularly important here: the selected interval [13,22] for Qwen3-4B is exactly the middle ten layers, and [12,21] for Qwen3-8B is also close to the center. The current results therefore do not establish whether the proposed score is useful or whether simply training middle layers would give similar results. The ablation in Appendix A.3 freezes the selected interval and trains all remaining parameters. This shows that excluding these layers can hurt performance, but it does not answer the question above. The paper also does not isolate the effects of the raw spectral norm and the detrending step. In addition, the five repeated runs are evaluations of the same checkpoint; training uses only one seed. It is therefore unclear whether the differences between methods are stable across training runs.
-
The metric’s definition and implementation are not clearly reconciled, and its connection to training gains remains insufficiently tested. Under Eq. (5), for a sequence of length (T), the final-layer Jacobian is the identity only for matching token positions. Averaging over all causally reachable position pairs therefore gives (2I/(T+1)), rather than (I). This conflicts with the statement in Section 4.2 and Appendix A.2 that the final layer’s spectral norm is always 1. There may be an additional normalization that is not described, but the authors need to clarify what was actually computed. Section 3.4 also omits the complete power-iteration procedure, iteration count, and probe-vector settings, making the estimator difficult to check. More broadly, a large possible change in hidden representations does not establish that parameter updates can realize that direction or that doing so improves reward. The authors acknowledge that this connection has not been tested. The current single-layer experiments cover only ten selected layers in one model and provide limited evidence for the score’s predictive value.
Questions for authors
- Clarification: Do the experiments compute the aggregated Jacobian exactly as defined in Eq. (5)? If so, how is this consistent with a final-layer spectral norm of 1? Please provide the formula actually used and pseudocode for the estimator, and clarify whether the exact and VJP-based methods compute the same quantity.
- Additional evidence needed: Under the same ten-layer budget and training setup, does Fulcrum outperform a fixed middle interval, random contiguous intervals, and selection using the spectral norm without detrending? If these results are available, please also report variation across independent training seeds. These comparisons would directly affect my assessment.
3 comments
As the rebuttal deadline approaches, we would appreciate hearing your thoughts on our responses. We have clarified your issues concerning the equations and wording, results are consistent across seeds, and presented evidence that our method differs from simply mid-selecting.
In light of these clarifications and results, we respectfully believe that the weak-reject assessment merits reconsideration. We hope the author can engage in the discussion and let us know whether any concerns remain. We would be happy to provide further clarification.
If you remain inclined toward rejection, we would appreciate specific, actionable feedback for the valuable weaknesses thus we could address them to improve our work.
I thank the authors for the corrections and additional experiments. However, they do not resolve my central concerns.
I thank the authors for the corrections and additional experiments. However, they do not resolve my central concerns.
W1: The new comparison is only on Qwen3-1.7B, and it does not provide the direct controls I requested under the same ten-layer budget and training setup: fixed middle intervals, random contiguous intervals, and raw-spectral-norm selection without detrending across all models. Showing that Fulcrum differs from the middle on Qwen3-1.7B does not address the fact that on Qwen3-4B the selected interval is exactly the middle ten layers and on Qwen3-8B it is very close to the middle. The reported average gap on Qwen3-1.7B is small (42.97 vs. 42.38), and [8,17] is close (42.61); with only evaluation-seed variation and a single training seed, this is not sufficient to establish that Fulcrum is better than simple selection rules. Table R3 also does not include random contiguous intervals or independent training runs.
W2: The response concedes that Eq. (5) has a typo and that Section 3.4 incorrectly describes the estimator as power iteration; the actual implementation is a Gaussian-sketch proxy, not an exact spectral norm. This does not reconcile the metric’s definition with the reported final-layer spectral norm of 1, nor does it establish that the ranking proxy and the defined quantity are the same object. Correcting the formula and adding pseudocode is necessary, but it does not resolve the soundness concern about what was actually computed and whether this score predicts training gains.
Therefore, these responses do not change my assessment.
Reply to Reviewer oixg
We thank the reviewer for the detailed review of our paper.
W1. Fulcrum differs from simple middle selection.
Fulcrum is not a "middle-layers" rule. Although the selected intervals happen to lie at or near the center on Qwen3-4B and Qwen3-8B. It is an outcome of the potential profile, not an assumption of the method. In contrast, on the other two models in our experiments, Qwen3-1.7B and the SDXL U-Net, the selected layers are not in the middle.
Table R1. Fulcrum-selected intervals vs. middle intervals.
Table R2. Fulcrum vs. the middle interval performance on Qwen3-1.7B-Base. Results are averaged over five evaluation seeds.
W2. Writing errors in the paper.
We thank the reviewer for the careful derivation.
(1) Incorrect formula. Eq. (5) contains a typo in the normalization coefficient: it should be Tn but not Tn(Tn+1)/2. Fulcrum sums the cotangent at all target positions, and then averages over source positions. For the final layer, the exact Jacobian reduces to the identity, yielding an exact spectral norm of 1
(2) Incorrect wording. Section 3.4 incorrectly describes the estimator as "power iteration". The implementation performs no iteration: it estimates σl with a Gaussian sketch, in which P fixed-seed standard Gaussian probes are placed as cotangents on the final representation,a single round of VJPs yields Sₗ = UᵀĴₗ for all layers at once, and σl is estimated as σₘₐₓ(Sₗ)/√P. There is therefore no iteration count or convergence criterion. The Gaussian sketch provides a computationally efficient proxy for the spectral norm used in layer ranking, rather than an exact evaluation of the full Jacobian's spectral norm.
We note that this estimator is a standard randomized sketching technique from numerical linear algebra [1], used solely to accelerate the computation of σl. It is not a methodological contribution of this paper. Our contribution lies in defining layer potential through the downstream Jacobian and in turning it into a training-free layer-selection rule.
We sincerely apologize, thank the reviewer for pointing them out, and we will correct them in the paper. We will also add the pseudocode to the appendix.
Q1.
Please see our response to W2.
Q2.
To further examine the effectiveness of the selected interval, we provide an additional interval ablation:
Table R3. More interval training on Qwen3-1.7B-Base. Results are reported across five seeds.
The Fulcrum-selected interval achieves the best average performance among all tested partial-training intervals, approaching full fine-tuning.
Fulcrum offers a practical contribution: a training-free criterion that identifies a small set of layers within seconds, enabling RL post-training to approach full-parameter performance with substantially lower memory requirements. We welcome further discussion and would be grateful if the reviewer could reconsider their evaluation in light of these corrections and additional results.
Reference
[1] Halko, N., Martinsson, P.-G., & Tropp, J. A. (2011). Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions. SIAM Review, 53(2), 217–288.