- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the influence of optimization history on task interactions in multi-task learning (MTL). The authors argue that instantaneous model information, such as task losses and gradients, is insufficient to characterize future task interactions when stateful optimizers are used. By analyzing task-attributed optimizer momentum, the paper demonstrates that different optimization histories can lead to different task interactions and subsequent training decisions, even when the current model parameters are identical. The authors further introduce the Aliasing Decision Gap and establish a theoretical lower bound on the regret of snapshot-only task-selection policies.
Critical strengths
- The paper presents an interesting perspective on multi-task learning by investigating the role of historical optimization information, rather than relying solely on instantaneous task gradients or losses.
- The analysis is thought-provoking, and the empirical investigations across different models and tasks provide evidence that optimization history can substantially influence task interactions and subsequent training decisions.
Critical weaknesses
- The paper primarily focuses on analyzing how historical optimization information influences multi-task learning and demonstrates the limitations of snapshot-based task selection. However, it does not provide concrete strategies or mechanisms for leveraging this information to improve MTL. Consequently, the practical implications of the analysis remain unclear, making the overall contribution feel somewhat incomplete.
- The observation that instantaneous model information is insufficient to characterize future optimization dynamics under stateful optimizers is relatively intuitive, given the dependence of their updates on historical states. Although the paper extends this observation to task interactions in MTL, it remains unclear what fundamentally new insights are established beyond this known property of optimization dynamics.
Questions for authors
- How can the theoretical findings of this paper be translated into practical guidance for improving multi-task learning?
- Could the authors suggest or demonstrate a concrete history-aware MTL strategy motivated by their analysis, such as history-aware task selection or task weighting?
- Regarding Theorem 4.1, the result appears rather general: when two indistinguishable states require different optimal actions, a policy restricted to their common observation necessarily incurs regret. What additional insights does this theorem provide specifically for multi-task learning? Can it offer more concrete guidance for the design of effective MTL algorithms?
- The current analysis does not appear to explicitly address the influence of task-specific loss scales. In practical MTL, differences in loss magnitudes and gradient scales can significantly affect optimization dynamics and task interactions. How are these factors accounted for in the proposed theoretical framework, and to what extent might they influence the reported conclusions?
In general, I find the perspective of this paper interesting and theoretically thought-provoking. However, my main concern is that the analysis primarily establishes the importance of historical optimization information without explaining how such information can be effectively utilized to improve multi-task learning. Moreover, some of the theoretical conclusions appear relatively intuitive or general, raising questions about the novelty and significance of the contribution. I believe the paper would be substantially strengthened by providing more concrete and constructive insights into how historical information should inform multi-task optimization. In particular, a plausible history-aware strategy or a deeper theoretical characterization of its potential benefits would help establish the practical significance of the findings. I would be open to increasing my score if the authors could provide convincing clarification or supporting evidence addressing these concerns.