W1. Presentation
The paper is not easy to follow. In several parts information seems misplaced or missing.
I give a non-exhaustive list of examples from the text to clarify what I mean. I believe this work would benefit from substantial rewriting.
W1.1. In multiple places there is a mention to a "historical" selector. What does historical selector mean? This sounds like a separate method that was done before the main content of the paper.
W1.2. In Section 3.1, the paper mentions that the principal directions are "retained by an energy rule". This rule is seems to be explained in Section 3.4, where they describe how they estimate energy for a candidate rank. A method-level description of this could be closer to Section 3.1, or it could be worth to point, in Section 3.1, that the energy rule is explained in Section X.
Also related to the rank retention, the fact that some truncation of the principal components is part of the method appears without "proper notice". It could be worth to have this more explicitly mentioned when describing the method in the Introduction.
W1.3. In the same Section, the paper writes: "Given budget k, we select the k smallest scores, ...". It is not clear for what k is being selected, specially considering that comparisons are done by always removing a single block (so it is not the case that k blocks are being selected). Probably, it means that the removal of top-j block ranked by the proposed method is compared with the removal of the top-j block ranked by BI.
W1.4. Also in Section 3.1, the sentence "projection discards amplitudes within retained directions" is not clear to me. What is being projected? If something is being projected on the retained directions, why would their amplitudes be discarded?
W1.5. Section 3.4 then seems to touch on several different topics, and the sections organization could benefit from some restructuring. In several parts, it seems closer to an Experiments section, instead of a Method section. For example, it describes that both the proposed approach and BI use "3,000 common token positions sampled from a 9,000-token pool drawn from 100 frozen assistantmessage texts (10,577 nonpadding tokens)". Personally, I believe this is closer to an Experiments section which described the dataset that was used. At the same time, this same section also described their energy rule: "For candidate rank r, estimated energy is the sum of the first r squared singular values divided by the exact ∥X~L∥F2 .", which is part of the method description.
W1.6. Also in Section 3.4, a few expressions are introduced which I believe are not explained, such as "Gaussian range finder".
W1.7. Section 3.4 also appears to give information that are implementation details, and are out-of-place. For instance, the seed values of the runs are given ("The main seed is 42; sensitivity seeds are 7 and 123."), and it is mentioned that the implementation uses "explicit block hooks" ("The matched implementation uses paired positions and explicit block hooks;").
W1.8. There are also some examples in Section 4.1. A checkpoint revision value ("1df85071 78afcc1bef68cd8c393f61a886323761") is specified for the model that was used. This seems out-of-place and also unclear.
W1.9. (~ l. 205) The description of the dataset is not clear. In the paper, it is also mentioned that a metallurgy dataset was used. This same paragraph also has information that could be better positioned in an appendix (e.g., "questions are selected deterministically"). The same paragraph closes with "These questions come from the previously studied workload, not an independently held-out benchmark; training overlap is unresolved.", which is not clear.
W1.10. Section 4.2 also presented out-of-place mnetions such as a seed number ("Its percentile interval uses 2,000 stratified bootstrap resamples of the 144 declared question groups, with seed 2026") and a reference to a specific snapshot ("Snapshot 005 preserves inputs, runtime, spectra, losses, ...").
W2. Empirical Rigor
The work does not provide sufficient experiments to support claims and a better understanding of the proposed method.
W2.1. They consider only block-by-block removal, this ignores interactions between block removals
W2.2. The method seems to be evaluated on a single model.
W2.3. The dataset used is not clear, and is not part of the datasets that are typically used in the context of block pruning methods.
W2.4. There is a lack of baselines as well, since there are several other related methods on dropping blocks.
W2.5. The results are inconclusive, as the authors themselves mention in the conclusion: "The current evidence supports a characterized selection signal; it does not establish a universally stronger ranking."
W2.6. I also think that the initial premise about having mean shifts in the residual streams should be evaluated empirically (and contrasted with maybe the variance). And if it is indeed the case that the population means are dominating the cosine similarities of BI, then a simpler ablation where just the mean is removed prior to the computation of the cosine could be evaluated.
Response to Reviewer bENC
Thank you for the suggestions. Activation-projector distance compares centered activation subspaces and provides a rank-angle decomposition that explains its block selections. The formula contains no metallurgy-specific features or rules, which is the intended meaning of “the selection rule itself does not depend on that domain.” The activation distribution, estimated subspaces, scores, and selected blocks can all change with the calibration texts. We do not claim invariance to the probe set. Stability at three sampling seeds within one pool supplies no evidence of stability across math, code, or other domains.
The name “activation-projector distance” also describes the computation more precisely than “geometry.” For a token-by-feature activation matrix Xℓ, we subtract its column mean, estimate its leading right singular vectors, and retain the smallest rank meeting the 90% energy target, subject to the stated approximation cap. The retained vectors form Uℓ; rℓ is their number, and Pℓ=UℓUℓ⊤ is the orthogonal projector. The block score is the Frobenius distance between consecutive projectors. These definitions and the truncation rule belong with Equation (1).
BI averages cosine changes of paired token vectors. Our score compares the retained subspaces of centered activation populations and is insensitive to translations, singular-vector signs, and singular-value weights within the retained subspace. The analytical examples show that the two statistics can disagree. The projector identity is classical. We apply and evaluate it for candidate selection, using the decomposition to explain the actual choices.
All 15 selected transitions have rank one at both endpoints and meet the energy target. Ranking their angular changes alone recovers the entire geometric shortlist at all three calibration seeds. Geometry and BI share only six of the 15 choices, yet their mean singleton-deletion losses are close: −0.1483 and −0.1439 nats, with an unresolved paired contrast. This supports an interpretable alternative signal on the tested model and workload, while superiority and domain-independent selection remain unestablished.
The validation covers one model family, calibration pool, domain, and response-conditioning protocol. Math/code calibration and evaluation would test how both selections and deletion effects change across domains.