- The shared weight space produced by CoRe is not shown to be identifiable, and the central finding that signed update direction is organized by task may be produced by the conversion procedure rather than by what the methods learned. The paper's own measurement indicates the problem. Independent re-distillations of the same expert under different LoRA initializations reach a cosine of only about 0.06 (Appendix E), so two functionally equivalent conversions of a single expert are nearly orthogonal in this coordinate system, and the alignment of an update with the shared direction is about 0.02. Most of each converted update is therefore determined by the conversion rather than by the expert's function, and parameter-space comparisons between conversions need to control for the factors that the conversion shares across runs. The released code suggests that these factors are shared precisely along the task axis. In core/distillation.py the distillation seed is the global seed plus 300007 times the task index, independent of the method, and the student's per-task LoRA slots are initialized together under that seed (backbone/vit_inflora.py, init_param), with zero-mode initialization using slot t for task t. Since the paper states that seeds are shared by every method, the conversions of all seven methods for a given task appear to start from identical A matrices and to see identical minibatch order and augmentation, while conversions for different tasks use different slots. This alone would make same-task pairs more aligned than same-method pairs, which is the pattern reported in Fig. 1a (+9.10 SD against −1.26 SD). The label-permutation control does not exclude this explanation, because it measures the transplant gain of the estimated component rather than the alignment between methods (Fig. 2a), and an alignment produced by shared initialization would not be expected to transfer task accuracy under permuted labels in any case. The required control is to repeat the analysis of Fig. 1 with independent LoRA initialization and data order for each method, and to report the re-distillation reference with the same initialization as well as with a different one.
A second validation that the setup permits is also absent. InfLoRA and LCA already learn exact weight-space increments, so the converted update of these methods can be compared directly with the increment it is meant to represent. Given the re-distillation cosine of 0.06, I expect this similarity to be low, which would mean that the coordinates do not recover the weight-space knowledge even where it exists. The choice of target space raises a related concern. The student acts only on the query, key and value projections, justified by the statement that prompt effects act there (He et al., 2022; Dherin et al., 2025). However, Dherin et al. (2025) derive that the effect of context is equivalent to a rank-1 update of the MLP weights following attention, not of the attention projections, and APER-Adapter inserts its adapter at the MLP. Energy allocation is measured over these 36 projection blocks only, so the reported method effect on allocation (+0.35 SD against +0.13 SD for task, Fig. 1a) may largely reflect where each method inserts its parameters, for example the layers that receive prompts, which is known by construction. All similarity results are reported in standardized units relative to the both-different pairs, without raw cosines, and the pairs are not independent because each update enters many pairs. The magnitude of the effect behind "nine standard deviations" therefore cannot be assessed.
The behavioral transparency of the instrument is also weaker than presented. Eq. (1) requires that consolidation leaves the method's decisions unchanged, yet Table 5 shows that CoRe lowers average incremental accuracy in 39 of the 49 method and benchmark cells, by 0.75 points on average, by 2.13 points on average for LCA and by up to 4.57 points (LCA on ImageNet-A). The Pearson correlation of 0.9947 cited as evidence of preservation is dominated by differences between benchmarks (CARS near 0.5 against CIFAR-100 near 0.9) and is not informative about this systematic decrease. The comparison with merging operators in Table 1 is also difficult to interpret. With λ=1 and the spectral normalization of Eq. (3), the regularized write attenuates the update by at most a factor of two along at most P=8 directions in a space of about 2.1×107 coordinates, and Appendix C reports that it changes the past-margin response by only 3% to 19% with the default sketch. It is therefore unclear how this write yields 4.2 points more agreement and a five-fold lower logit KL than the unconstrained write, unless the rows also differ in the rebase step or in the validation-selected repair W←Wˉ+ρCt (Algorithm 1, line 26). The baselines are implemented in a replay script (tools/replay_pet_merge_fidelity.py, referenced in merging/operators.py) that is not included in the supplementary material, so this cannot be checked. Since every subsequent analysis treats CoRe as a transparent and identifiable measurement instrument, this is the weakness that most strongly determines my rating.
- The evidence for the functional role of the shared component is small in magnitude, partly an artifact of the normalization used, and does not support the conclusion about what a backbone should learn. Transplanted alone, the shared component recovers 16.1% of the full update's gain (+0.731 points), while the held-out method's own update scaled to the same norm recovers 11.6% (+0.527 points). The difference attributable to the shared direction is therefore about 0.2 points, reported without uncertainty, which is difficult to reconcile with the conclusion that the component is "causally sufficient to guide task decisions". The statement that a matched component improves its own task "by six times the gain obtained from components of other tasks" is not meaningful under the reported procedure. Outcomes are centered on each evaluation task's mean over donors, so the mismatched values sum to the negative of the matched value and are negative by construction, as visible in Fig. 2b, and their ratio to the matched gain is not defined in a useful sense. Fig. 2b also shows that roughly a fifth of the 49 matched values are at or below zero.
The conceptual interpretation of the component also needs qualification. The shared direction is the leading eigenvector of six unit-norm donor updates (Eq. 7), which approximates their normalized average, and with a single donor it is simply that donor's update direction, as Appendix F notes. The finding is therefore close to the statement that an update trained on task τ by one method improves task τ more than updates trained on other tasks, which is expected from task arithmetic and does not by itself isolate a method-invariant core. Comparisons against the plain average of donor updates, and against re-distillations of the held-out expert itself, would clarify what the eigendecomposition adds. The preservation result in Appendix E follows from dimension counting alone. A sketch spanning at most eight directions in 2.1×107 dimensions will preserve almost any direction that is not aligned with past margins, so the retention of 99.98% would hold for a random direction as well, and the claim that writing the shared component "costs essentially none of the protection budget" is not specific to the component. A random-direction control would establish this. Finally, the practical demonstration in Appendix F uses a single benchmark (CARS), a single run, a single baseline (LCA), and a shared direction estimated from other PET methods trained on the same stream. This gives the proposed learner additional training runs and supervision that LCA does not have. The demonstration also lacks the ablation that would isolate the contribution of the shared component, namely the same rank-32 compression and fold without the closed-form adjustment toward ct⊤at. The statement in the conclusion that a minimal learner "can reach the level of a recent method of the same family" is therefore not supported as stated.
To sum up, the paper's central empirical claims depend on parameter-space comparisons in a coordinate system that the paper's own measurements show to be weakly identified, with a plausible confound in the released implementation. The instrument does not preserve the behavior of the methods it is meant to measure, the causal evidence amounts to about 0.2 accuracy points beyond a norm-matched reference, and the conclusion about what a backbone should learn is not supported by any experiment that writes this component in a continual-learning stream beyond a single run on CARS.