- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This paper studies pretraining on a target task together with additional source tasks in in-context learning. It theoretically analyzes the possible negative effects of adding those tasks. The results show that when the added tasks have high variance in the target-task directions and low variance in other directions, the eigenvalue gap becomes larger, which the paper treats as positive transfer. Otherwise, adding the tasks can hurt performance.
Critical strengths
A key strength is that the paper explains when adding source tasks helps or hurts performance on the target tasks theoretically. It gives a precise threshold beyond which the added tasks cause the model to lose important information about the target tasks.
Critical weaknesses
- The motivation is insufficient. The authors say that training is "often broadened by adding related source task families," but they do not cite practical papers that support this claim. They also say that the effect of adding tasks on the original task is not well understood, but they do not adequately compare this point with prior work. As written, it is unclear whether the paper studies a method that is commonly used to train real LLMs, whether that method causes a practical problem, or what is currently unknown about that problem. To make the motivation convincing, the authors should ground it more clearly in prior work, especially practical studies of real-world training methods, and explain how this paper builds on them.
- The discussion is often abstract, and the information is not presented in a clear order, which makes the paper very difficult to read. All sections are hard to follow, but the Introduction is especially difficult. The following examples were unclear to me when I first read the paper.
- "The Bayesian formulation makes this role explicit" (L36): Does the explanation that follows explain why the Bayesian formulation makes the role explicit?
- "The inverse map depends on the prior only through the target subspace" (L37): What does this mean?
- "ridge ratio" (L38): What is this of?
- "The block-diagonal source assumption" (L42): At this point, it is unclear what this means.
- "Pooled mLSE covariance" (L44): At this point, it is unclear what is being pooled or which covariance is meant.
- "The covariance identity" (L72): This probably refers to Eq(9), but readers do not see what it means at this point.
- "When off-target source variance exceeds the smallest on-target source variance" (L73): This sounds like it compares a scalar with a matrix.
- "A controlled two-stage ridge estimator" (L74): What makes this estimator "controlled"?
- "Under the stated dimension condition" (L75): With respect to what is the excess measured?
- "Off-support sources" (L76): What does "support" refer to?
- "Under the stated dimension condition" (L64): The text refers to a dimension condition, but no such condition appears at this point.
I believe substantial revisions to the entire paper are necessary for acceptance.
Questions for authors
- The paper's main contribution seems to be that mixing in source tasks can hurt estimation when their differences from the target task are strong. However, negative transfer from source tasks that do not align with the target is a classical finding in multitask learning and transfer learning. The paper also notes that this has been already shown in ICL. Although this paper studies a different model theoretically, does it offer any new insight beyond deriving the same result for a specific ICL model?
- In real-world LLM pretraining, what does the operation "often broadened by adding related source task families" refer to?
- Can adding source tasks improve performance under the setting studied in this paper? Also, why is the eigenvalue gap a justified measure of positive transfer? If adding source tasks does not improve performance, why add them?
- What practical procedure does the heuristic of selecting the top tasks abstract?
- cTRE assumes that and are known. Please explain in more detail why this simplification is justified.
We thank the reviewer for reading the paper carefully and for the constructive comments, which will help us to improve the paper.
Q1 (What is new?). A mechanism with an exact threshold between positive and negative transfer, particularly a rigorous mathematical theory for this phase transition. This builds on previous empirical observations, but to our knowledge, it is the first rigorous mathematical analysis for the learning theory.
Q2 (What does "broadened" refer to in real-world LLM?). Our model does not describe language-model pretraining. Our model is motivated by scientific foundation models trained on several PDE families, operator families, or image processing families. Returning to LLMs, just as an analogy (possibly a bad one), when the original tasks are math proofs, one may use non-math literature data for broader pretraining, e.g., novels or science books.
Q3 (Can sources help? Why the gap? Why adding them when they may not help?). Yes, adding aligned sources lowers the risk bound. The gap is necessary for the pre-training to recover the low-dimensional prior, necessary to solve the underdetermined linear system.
In practice, we don't know a priori whether additional training data would help: for example, in PDE modeling or MRI image processing, we have limited pre-training data and don't have the ground-truth task prior, so we use other datasets to broaden pre-training.
Q4 (What practical procedure does the heuristic of selecting the top tasks abstract?). Learning a shared low-dimensional representation across tasks. This is a low-rank prior in the Bayesian setting or the regularization in inverse problems. Any successful pretraining must identify that low-dimensional representation.
Q5 (Why assume rw and ρ known?). They serve as a control: they make the excess risk exactly the subspace error, which can be rigorously analyzed. If they are to be estimated from data (i.e., as in dTRE), rigorous analysis is difficult, and their estimation error will degrade the phase transition, as shown in the numerical results of dTRE in Figure 3.