- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates model adaptation in nonstationary data streams under delayed supervision and limited parameter update budgets. To address this problem, the paper proposes Drift-Decomposed Adaptation (DDA), which selects parameter blocks using temporal differneces between gradients computed over historical and recent windows. This paper conducts experiments on synthetic data, Appliances and Fjord5G to evaluate DDA.
Critical strengths
- This paper considers delayed supervision and constrained update budgets, which are important challenges in practical nonstationary learning systems.
- The anchored reachable-risk framework provides a useful way to distinguish distributional changes from prediction errors that can be corrected.
Critical weaknesses
- The theoretical results rely on restrictive assumptions, and the resulting risk bounds may be vacuous in practically relevant nonstationary settings. This limits the informativeness of Theorem 4 and Corollary 3.
- The experimental results do not demonstrate the effectiveness or robustness of DDA. On Appliances, DDA achieves an RMSE of 0.5354, which is slightly worse than GradMag and Recent gain. Furthermore, DDA does not achieve the best performance on any of the four additional Fjord5G segments reported in Appendix Table 18.
Questions for authors
See weaknesses.
Dear reviewer,
Have the authors address your concerns in their replies?