- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper asks whether the same models provide different value as inference-time partners and as training teachers. It introduces a “supply–conversion” framework to separate the useful capabilities that additional models offer from the gains a system actually obtains. For collaboration, where two models generate answers and a judge selects one, the paper derives an exact decomposition: the gain over the stronger model equals complementary coverage minus selection loss. For distillation, it measures student improvements from single teachers and uniform two-teacher mixtures. The experiments cover four task domains, 18 teachers, and three students, with nine shared model pairs compared across roles. The results suggest that disagreement alone does not guarantee useful collaboration, a good partner is not necessarily a good teacher, and uniform teacher mixing under a fixed budget usually falls short of the better single teacher. Finally, the authors combine small task-specific probes with cross-pair judge calibration to choose between single-model inference and collaboration, achieving lower selection regret than the evaluated baselines.
Critical strengths
The paper presents a broad and relatively systematic empirical study with appropriately demanding reference points. The main study covers 18 teachers, three students, and 54 single-teacher training configurations across mathematics, science, coding, and logical reasoning. It also evaluates nine shared candidate pairs in both inference-partner and training-teacher roles, expands the collaboration analysis to 23 retained pair configurations, and includes additional sensitivity studies on supervision construction, training budget, optimization, and data filtering. Importantly, collaboration is compared against the stronger single candidate, while teacher mixtures are compared against the better single-teacher student, rather than only against a weaker target model. This experimental coverage, the controlled cross-role setup, and the reporting of negative results make the empirical evidence more informative than a small collection of selected case studies.
The collaboration analysis is simple but interpretable and diagnostically useful. The paper decomposes the gain of fixed-answer collaboration into complementary coverage and judge selection loss, providing a clear account of why a model pair succeeds or fails. The authors also evaluate cross-pair judge calibration, held-out-pair prediction, and decision performance under different probe budgets. These experiments provide some evidence that the analysis may help decide when collaboration is worthwhile, rather than serving only as a post-hoc description of observed results.
Critical weaknesses
The main findings feel somewhat intuitive, and the scientific novelty is limited. The paper shows that model disagreement does not always mean useful complementarity, that complementary answers help only when the judge can select them correctly, that a good inference partner is not necessarily a good teacher, and that uniformly mixing two teachers may be worse than using the better teacher alone. These results are carefully supported by a substantial amount of experimentation, but most of them are not particularly surprising given that inference-time collaboration and offline distillation use different mechanisms and evaluation baselines. Several of these observations are also closely related to recent work on model ensembles and teacher–student compatibility. Therefore, I am not fully convinced that the paper provides a substantially new scientific insight beyond carefully formalizing and validating reasonable intuitions.
The connection between the online and offline settings feels mostly conceptual, and it leads to limited methodological progress. The supply–conversion framing gives the two settings a shared vocabulary, but the actual analyses remain separate. The online setting has an exact accounting identity for selecting between two fixed answers, while teacher value is mainly measured after SFT and does not have a comparable pre-training characterization. It is therefore unclear what we gain from studying the two roles together rather than analyzing collaboration and teacher selection separately. The paper does introduce an online decision rule using task-specific probes and cross-pair judge calibration, but the final decision mainly comes from estimating the terms in the derived identity and plugging them into the formula. The teacher-selection rule is also simple and does not outperform the parameter-count baseline in the reported results. Overall, despite the large experimental effort, the framework does not yet lead to a new collaboration mechanism, distillation objective, or competitive teacher-selection method.
Questions for authors
What do we actually gain by studying inference-time collaboration and training-time teachers under one framework? The online part mainly analyzes selection between two fixed answers, while the offline part measures student performance after SFT with different teachers. It seems that most of the conclusions could also be reached by studying these two problems separately. Could the authors clarify which key insight or decision capability specifically comes from the cross-role comparison?
What is the main new finding or practical capability of this paper compared with prior work? Previous studies have already shown that model disagreement or diversity does not always lead to ensemble gains, and that stronger models are not always better teachers. Recent work has also proposed more direct methods for teacher selection and multi-teacher routing. Beyond measuring these effects more systematically, what new understanding or actionable capability does this paper provide?
What practical conclusion should we take from the teacher-selection results? The current rule mainly selects the teacher with higher accuracy on a task-specific probe, but its reported regret does not outperform the parameter-count baseline. Do the authors view this as a practically useful teacher-selection method, or mainly as evidence that teacher value is still difficult to predict before training? Please clarify how this result fits into the paper’s overall contribution.
4 comments
Response to Reviewer DN6S - Part 2
2. What is gained by studying online collaboration and offline teaching under one framework?
The shared candidate pool separates available capability supply from the gains realized by different mechanisms. Online integration selects among fixed answers, whereas offline SFT changes student behavior through training. The common event decomposition provides a shared measurement basis:
-q_{10}(1-u_{10})-q_{11}(1-u_{11}).$$ The four terms represent recovery of teacher-only coverage, successes when both models were initially wrong, loss of student-only successes, and loss of shared successes. Fixed-answer selection satisfies $u_{00}=0,u_{11}=1$, whereas SFT is not subject to these constraints. Cross-pair calibration tests online conversion, while quality-guided supervision allocation tests offline conversion. **Offline intervention: quality-guided supervision allocation.** The main setting shares 4,000 prompts and 12,000 presentations; a separate control matches 12M supervised tokens. Quality-Single samples two answers from teacher B, whereas Quality-Mix samples one answer from each teacher, using the same training-side selection rule. **Table R3-D. Supervision-allocation ablation for Qwen4B.** | Training scheme | Pair 1 | Pair 5 | Pair 9 | | ----------------------- | --------: | --------: | --------: | | Teacher A only | 60.80 | 66.00 | 70.50 | | Teacher B only | 62.10 | 70.10 | 72.90 | | Fixed A:B=75:25 | 61.50 | 66.40 | 70.90 | | Fixed A:B=50:50 | 62.70 | 66.70 | 71.60 | | Fixed A:B=25:75 | 62.60 | 68.90 | 72.40 | | Epoch-wise reassignment | 62.90 | 69.50 | 72.60 | | Quality-Single B×2 | 62.90 | 70.80 | 73.10 | | Quality-Mix A+B | **63.30** | **71.90** | **73.60** | For Pair 5, Quality-Mix improves over fixed mixing by 5.20 pp, ordinary Single by 1.80 pp, and quality-controlled Single by 1.10 pp. **Table R3-E. Token-matched control for Pair 5.** | Scheme | Pair 5 | | ----------------------- | --------: | | Fixed 50:50 | 66.80 | | Epoch-wise reassignment | 69.30 | | Quality-Single B×2 | 70.70 | | Quality-Mix A+B | **71.50** | | Mix−Quality Single | **+0.80** | The Quality-Mix gain over Quality-Single is +0.80 pp, with a 95% CI of [0.43, 1.17]; its gain over fixed mixing is +4.70 pp, with a 95% CI of [4.10, 5.30]. Thus, the additional Pair-5 gain is not explained solely by the number of supervised tokens or the two-sample opportunity. **Table R3-F. Supervision allocation for the second student, GemmaE4B.** | Training scheme | Pair 1 | Pair 5 | Pair 9 | | ----------------------- | --------: | --------: | --------: | | Better ordinary Single | 64.60 | 73.50 | 77.10 | | Fixed 50:50 | 63.70 | 70.40 | 75.80 | | Epoch-wise reassignment | 64.10 | 72.70 | 76.70 | | Quality-Single | 64.90 | 73.90 | 77.50 | | Quality-Mix | **65.40** | **74.00** | **77.60** | | Mix−Quality Single | +0.50 | +0.10 | +0.10 | For the second student, quality-guided mixing improves over fixed mixing by 1.70, 3.60, and 1.80 pp. The two +0.10 pp differences over quality-controlled Single are not presented as significant gains.Response to Reviewer DN6S - Part 3
3. What is the practical implication of teacher selection?
The original T2 selects teachers using pre-SFT task accuracy. We further compare Student NLL, CAR, GRACES, and the compatibility-enhanced selection variant to evaluate role-dependent teacher value.
Table R3-G. Teacher-selection regret in restricted candidate pools.
| Teacher-selection rule | Regret |
|---|---|
| Generic-score / Capability profile | 2.160 |
| Original T2: target-task accuracy | 1.110 |
| Parameter count | 0.840 |
| Student NLL | 0.980 |
| CAR | 0.630 |
| GRACES | 0.570 |
| Compatibility-enhanced selection variant | 0.540 |
| Oracle | 0.000 |
The compatibility-enhanced variant reduces regret by 5.3%, 14.3%, 35.7%, and 51.4% relative to GRACES, CAR, parameter count, and original T2, respectively. Its paired improvement over GRACES is +0.030 pp, with a 95% CI of [0.008, 0.052].
Table R3-H. Component ablation of the compatibility-enhanced variant.
| Variant | Regret |
|---|---|
| Full method | 0.540 |
| w/o core compatibility signal | 0.620 |
| w/o calibration | 0.680 |
| w/o task-local information | 0.750 |
Table R3-I. Leave-One-Pair-Out generalization.
| Method | Mean regret over nine held-out pairs |
|---|---|
| Generic-score | 1.800 |
| Parameter count | 0.840 |
| CAR | 0.630 |
| GRACES | 0.570 |
| Compatibility-enhanced selection variant | 0.540 |
For each fold, post-training outcomes from the target pair are excluded from fitting and hyperparameter selection. The nine-fold mean regret is 0.540 pp.
Table R3-J. Complete-pool and teacher-removal robustness.
| Selection method | Full pool | Remove strongest | Remove top three | Randomly remove 40% |
|---|---|---|---|---|
| Fixed strongest | 0.000 | N/A | N/A | N/A |
| Generic-score | 0.000 | 0.150 | 0.450 | 0.550 |
| CAR | 0.180 | 0.250 | 0.550 | 0.650 |
| GRACES | 0.120 | 0.200 | 0.450 | 0.580 |
| Compatibility-enhanced selection variant | 0.000 | 0.100 | 0.300 | 0.380 |
In the complete pool, the compatibility-enhanced variant matches the strongest fixed teacher at zero regret. When the strongest teacher is unavailable, it outperforms GRACES in all three restricted-pool settings. The corresponding improvements are +0.100 [0.025, 0.175], +0.150 [0.060, 0.240], and +0.200 [0.090, 0.310] pp.
Together, these experiments establish three actionable capabilities of the cross-role framework: predicting collaboration gains under judge changes, selecting teachers under changing candidate availability, and improving student transfer through supervision-allocation interventions.
Dear Reviewer DN6S,
Thank you for your thoughtful feedback. We have provided additional analyses and clarifications addressing your concerns, particularly regarding the cross-role comparison, supervision allocation, and practical implications of teacher selection.
As the discussion period approaches its end, we would appreciate your feedback on whether our responses adequately address your concerns or if any points require further clarification. We would be happy to provide additional explanations.
Kind regards,
Authors
Response to Reviewer DN6S - Part 1
1. What actionable contribution goes beyond existing intuitions?
Thank you for this comment. Our framework provides three testable operations: predicting collaboration gains under different judges, deciding whether collaboration should be used, and intervening in offline supervision allocation. To this end, we have added some experimental evidence.
Online prediction: judge intervention with fixed candidate answers. For fixed candidate answers, Proposition 1 gives
GJ=(ηJ−ρ)D,ρ=21+2DΔ.
We evaluated Qwen3.5-9B and gemma-4-31B-it in addition to the original Qwen3.5-4B judge, keeping the candidate-answer cache fixed.
Table R3-A. Judge interventions with fixed candidate answers.
The same candidate supply yields different gains under different judges: Qwen9B does not exceed the threshold on pairs 8–9, whereas Gemma31B exceeds it on all nine pairs. This intervention validates the distinction between complementary supply and conversion quality.
Online decision: cross-pair calibration versus direct probing. T1 estimates the judge's conditional selection accuracy from other pairs and predicts the gain for the target pair; judge outcomes from the target pair are excluded from calibration.
wj,d=nj,dD^j,d.
N=∑j=kwj,dη^j,d
Z=∑j=kwj,d
η^−k,d=N/Z
The rule selects Team when Gk,d>0, and otherwise selects the single candidate with higher probe accuracy.
Table R3-B. Selection regret with 125 probes per domain.
Our regret is lower than Direct-Judge-Probe by 16.7% and 16.5%, respectively. The paired improvements and 95% CIs are +0.072 [0.012, 0.132] pp and +0.061 [0.014, 0.108] pp.
Table R3-C. Probe-budget ablation with Gemma31B as judge.
Our method achieves lower regret at all five budgets, with positive lower confidence bounds. Initial calibration costs 4,000 calls. With b probes per domain, direct probing requires 4b calls per new pair. The approaches break even after eight new pairs at b=125 and 100 new pairs at b=10.