- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies how shared training sources creates dependence among model errors. It represents model relationships as a DAG and decomposes error covariance into task, family, and propagated model-specific components. The decomposition allows characterizing when population growth diversifies propagated errors. Authors also study the difference between the individual objective and the population objective. Experiments are conducted on synthetic regression with ridge learners and neural networks to illustrate these effects.
Critical strengths
The framework gives an interpretable explanation of why adding more models don't necessarily diversify their errors. The root, star, and chain examples make the role of shared ancestry clear. The teacher-choice result clarifies the trade-off between individual accuracy and shared errors.
Critical weaknesses
The LLM problem was used as a motivation, but the authors conducted no actual experiments on LLMs or actual LLM lineages. I agree that synthetic regression experiments in sec 5 do provide useful illustrations, and I agree the theory paper doesn't need a complete LLM benchmark, but it would be beneficial to demonstrate how the mathematical model applies to e.g. a specific LLM training setting.
Questions for authors
- Can the authors give one concrete LLM application example and explain what the teacher and student errors represent, why the averaged-prediction loss is useful in that context, and how to interpret the error-transmission assumption there?
- Which conclusions are from existing network-aggregation results [1,2,3]? What new insight is from the lineage and teacher-choice formulation? A more explicit comparison would help assess the contributions.
References
[1] Seifert, Bastian, Chris Wendler, and Markus Püschel. "Causal Fourier analysis on directed acyclic graphs and posets." IEEE Transactions on Signal Processing 71 (2023): 3805-3820.
[2] Acemoglu, Daron, et al. "The network origins of aggregate fluctuations." Econometrica 80.5 (2012): 1977-2016.
[3] Golub, Benjamin, and Matthew O. Jackson. "Naive learning in social networks and the wisdom of crowds." American Economic Journal: Microeconomics 2.1 (2010): 112-149.
Thank you for your thoughtful questions. We clarify the applications and the relationship to the three references below.
Q1. Concrete applications and the interpretation of our framework
We consider two applications. First, in LLM distillation, student models learn to evaluate answers using scores provided by a teacher. Teacher and student errors are deviations from a common reference score, such as a human evaluation target. When several student scores are averaged to assess an answer, averaged-prediction MSE directly measures the accuracy of that assessment. If students inherit the same scoring bias, adding more scoring models only provide little improvement. In this setting, the error-transmission represents a student's centered error as a weighted combination of inherited teacher errors and a local error component. The transmission coefficients describe how strongly teacher errors carry into student predictions. In appendix B.1, we derive this relationship from a squared-loss training objective combining local supervision and teacher predictions.
Second, consider several banks choosing the same well-documented teacher LLM to reduce development costs and support model validation and compliance reviews. Each bank uses the teacher's risk assessments to train its own student model to estimate corporate default probabilities. Teacher and student prediction errors are the differences between predicted probabilities and subsequent default outcomes. While learning a teacher's analytical capabilities, students can also inherit its tendency to underestimate risk for certain firms. Sharing a high-quality teacher can therefore improve each bank's model accuracy while making the banks more likely to misjudge the same risks. The MSE of the average forecast measures whether these errors cancel across banks or remain in the collective assessment.
This has practical financial significance. The Bank of England[1] warns that common weaknesses in widely used models could cause multiple institutions to misestimate risks simultaneously, leading to credit mispricing and misallocation. This motivates our study of how shared errors accumulate through training relationships and how individually reasonable teacher choices can create population-level risks.
Q2. Relationship to existing results and the new insight
[2] provides a source-and-path representation on DAGs, which is one mathematical foundation of our framework. [3] studies how production networks transmit shocks and generate aggregate fluctuations. [4] characterizes how the distribution of influence in social learning determines whether individual noise disappears as the population grows. Our path expansion and error-diversification conditions build on these principles. We further explain how the training topology emerges endogenously from developers' teacher choices. When developers choose teachers to improve their own models' accuracy, they may converge on the same teacher or on teachers with shared ancestors. These individually optimal choices can concentrate inherited errors and worsen population performance. Our contribution therefore links how training relationships form to how errors spread through them and whether those errors diminish as the population grows. For example, theorem 7 establishes exact conditions in a finite population under which every developer strictly prefers the same teacher, yet every population-optimal assignment uses both teachers. This moves beyond studying error aggregation on a given network.
We also connect teacher selection to the origins of teacher-error overlap. Rather than taking this overlap as given, we express it through shared ancestors and transmission paths. This reveals when choosing different teachers actually diversifies the underlying error sources and when common ancestry preserves shared errors despite population growth. Appendix B.5 to B.6 further extends the teacher-choice analysis to multiple teachers, independent training, and compute costs.
For completeness, our General Response also reports additional experiments on transmission accuracy, population mechanisms, and larger teacher–student populations.
Reference
[1]. Bank of England. Financial Stability in Focus: Artificial Intelligence in the Financial System. April 2025.
[2] Seifert, Bastian, Chris Wendler, and Markus Püschel. Causal Fourier analysis on directed acyclic graphs and posets. IEEE Transactions on Signal Processing 71 (2023): 3805-3820.
[3] Acemoglu, Daron, et al. The network origins of aggregate fluctuations. Econometrica 80.5 (2012): 1977-2016.
[4] Golub, Benjamin, and Matthew O. Jackson. Naive learning in social networks and the wisdom of crowds. American Economic Journal: Microeconomics 2.1 (2010): 112-149.