- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates transferring LoRA capabilities across different model families. The authors first show an interesting observation that direct LoRA weight transfer works well between models sharing a parameter basis but largely fails across different families. Motivated by this finding, they propose a zero-prior skill elicitation framework that identifies behavioral differences between a base model and its LoRA-adapted version, evolves informative probes, and distills the resulting responses into student models. Experiments show promising improvements over native SFT and existing transfer baselines. While I find the analysis of LoRA transferability interesting, I am less convinced by the practical motivation and usefulness of the proposed framework.
Critical strengths
The analysis of LoRA transferability across model families is interesting. In particular, the contrasting results between shared-basis and cross-family weight transfer provide useful empirical insights and motivate exploring behavior-based alternatives.
Critical weaknesses
W1. Unclear practical significance. While the paper discusses scenarios where original training data is unavailable, I remain unconvinced about the broader practical significance of cross-family LoRA transfer. In particular, it is unclear how frequently such scenarios arise and when the proposed framework would be preferable to conventional distillation, given its reliance on a powerful teacher model.
W2. Limited guarantees on skill discovery. The method relies on an initial pool of generic probes, followed by evolution of high-divergence examples. However, it is unclear how the framework can discover skills that are poorly represented or entirely absent in the initial probe distribution. The sensitivity to initial probe selection and the completeness of discovered skills are not sufficiently investigated.
W3. Unclear source of improvements over native SFT. Although the paper includes several control experiments, it remains unclear to what extent the improvements come from divergence-guided skill elicitation rather than the quality of synthetic reasoning trajectories generated by a much stronger teacher. The current analysis does not fully disentangle these factors.
Questions for authors
-
What are the main practical scenarios where cross-family LoRA transfer is preferable to standard fine-tuning or distillation?
-
How sensitive is skill discovery to the initial generic probe distribution, particularly for skills not represented in the initial pool?
-
Can the authors further isolate the contribution of divergence-guided elicitation from the benefits of strong-teacher synthetic data?
2 comments
W2 / Q2. How sensitive is discovery to the initial generic probe pool, especially for skills that are poorly represented or absent in it?
We agree that discovery has no completeness guarantee. We have not run a dedicated sensitivity sweep over the initial pool, so we answer with the evidence the paper already contains and state the limit explicitly.
- The skill structure does not have to be in the pool; it can be recovered from the contrast. Appendix C reports a zero-prior audit at small scale. It removes every manually specified mathematics prior from the pipeline: the
<<>>regex patterns, arithmetic character sets, few-shot exemplars, and domain tag filters. From the base-versus-adapted trajectory contrast alone, the pipeline re-derives the same motif specification. It reaches 27.0% with 289 probes, against 27.5% under the manually specified constraints. - Evolution writes questions that the initial pool does not contain (§5.2). Parents are mutated by composition, constraint injection, and format perturbation, and every new question is rescored with the adapter/base contrast. Questions outside the pool's original coverage can therefore enter the curriculum. The static pool saturates at 1,294 usable probes, whereas evolution keeps producing new ones.
- Poorly represented modalities need explicit coverage pressure (Table 10). Without scarcest-modality refill, the elicited set contains 1 code example and 0 multiple-choice examples, and about 1,100 of its trajectories are math. With refill it contains 355 code and 112 multiple-choice examples. Divergence alone concentrates on the dominant mode, which is why the coverage constraint is part of the method.
- The operators matter. In the small-scale dose-response sweep (Table 9), student accuracy is 18.5% with no multi-step mutation and 34.5% at a mutation fraction of 0.5. What discovery can reach depends on which operators are available.
Taken together, these results show that discovery can reach structure the pool does not specify. They do not show that it finds every skill. A behavior that the mutation operators cannot approach from a generic pool would be missed. The revised Limitations paragraph (§9) now states this.
"Zero-prior" refers to the five priors of Table 1. The discovery algorithm receives no task identity, original data or seeds, labels, discriminator, or white-box access.
W3 / Q3. Can divergence-guided elicitation be isolated from the benefit of synthetic trajectories from a much stronger teacher?
Yes. The 2×2 in General Response Table G2 separates the two:
- Adapter-selected questions. With the adapted teacher answering in both arms, discovered questions add +1.94 [1.31, 2.57] at 4B and +3.79 [2.68, 4.90] at 9B (E+A − R+A).
- Adapted answers. With discovered questions in both arms, adapted answers add +4.21 [3.40, 5.02] at 4B and +4.45 at 9B (E+A − E+B; the 9B value is a difference of arm means).
- Strong-teacher synthesis alone. It adds nothing measurable: R+B is at Base, and the full pipeline is +4.78 above it at 4B.
Discovery matters much less when the base teacher answers: E+B − R+B is +0.57 [−0.34, 1.48] at 4B and +0.39 [−0.62, 1.40] at 9B. Both intervals include zero, so the discovered questions pay off when they are paired with adapted answers. The 27B-teacher replication in Table G3 shows the same effect of discovery under adapted answers (+2.28 on the 4B student, +4.83 on Llama-3.1-8B).
Thank you for the review and for the questions on practical use and on the limits of skill discovery. The new control against ordinary distillation from the same strong teacher is shared with the other reviewers, so its tables are in the General Response (Tables G1–G3). Below we answer each point.
W1 / Q1. When is cross-family LoRA transfer preferable to conventional fine-tuning or distillation?
The main case we target is base-model turnover. A platform that maintains many adapters, for example one per customer or per product line, has to move all of them when the base model is replaced or retired. In that setting:
Migration then has to be automatic and independent of task information, which is what the zero-prior design provides. The source model stays queryable until it is retired. Elicitation is paid once per adapter, and its curriculum is reused for every target. Table 3 already includes the one-time teacher cost: for three targets the total is about 62.7 B200 GPU·h for our pipeline against about 116 for Native training, 53.3 less.
A second case is an adapter whose weights cannot be moved. One example is a model fine-tuned through a hosted service, where the owner can sample from both the fine-tuned model and its base but cannot download weights. Our method needs only sampling access to those two models, with no weights or gradients (§5; the revised Ethics statement states this requirement).
When the labeled data are still available, Native SFT remains an option. In the cases above they are not, so the practical alternative is ordinary distillation from the same strong teacher. We tested that comparison directly (General Response, Table G2):
The advantage of the method is therefore not the strong teacher. It is what the adapter adds.
Following Reviewer Rt78, all Qwen students are also re-scored at a longer generation budget, because the 2,048-token limit in Table 2 truncated many Base generations. Against the untrained Base, the three-seed students gain +0.93 / +5.79 / +2.92 on the five-benchmark mean at 27B / 9B / 4B (Table G1). The revision reports them in §6 and Table 18.