- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper addresses an important problem, namely, the memory-error tradeoff in continual time-series forecasting. A rigorous theoretical framework is proposed. It models regime-specific forecast laws as a Wasserstein metric space, derives nearest-center clamping certificates by covering arguments, and proves a matching memory exponent for a restricted anchored-translation class with public condition nets and a finite expert codebook.
Critical strengths
-
The memory cost of eliminating parameter interference is a practical and interesting question. The paper usefully distinguishes preserving old experts from obtaining good forecasts under a fixed resource budget.
-
The mathematical statements carefully separate finite-regime certificates, restricted minimax results, and scheme-specific adapter costs. The explicit distinction between upper offsets and lower error floors substantially improves interpretability.
Critical weaknesses
-
This paper lacks sufficient illustration about the theoretical results or the problem setup. It is hard to understand some of the concepts, definitions, and theorems. Moreover, it lacks enough motivation and connections for the proposed theoretical results, making it hard to capture the core contribution of this work. The authors should provide a more detailed description of the setup, the problem, potential practical contributions, and the connection between theoretical results and practical implementations.
-
The connection between the theoretical error and forecasting utility remains unresolved. Sections 3.1-3.3 bound W2 distances between regime-level forecast laws, whereas Tables 5-8 evaluate paired prediction-target MSE. Matching an unconditional output distribution does not preserve the correspondence between inputs and targets: permuting forecasts within a regime can preserve the law while changing prediction error. Section 5 acknowledges this mismatch, but it affects the interpretation of the central memory-error claim. Please define precisely whether the laws are conditional on the full forecasting input, establish a loss-comparison result under appropriate coupling assumptions, or experimentally evaluate the actual Wasserstein quantity certified by the theorems alongside MSE.
-
There are some writing problems or presentation errors in this manuscript. For example, Fig.2 is improperly clipped, Tab.7 has an extremely large size of font, and the font size in Fig.1 is too small. These problems should be addressed before the submission of this manuscript.
-
The rank-adapter rule is not established for the implemented architecture. Design Principle 4 and Proposition 6 require an explicit realization of the leading functional displacement subspace by rank-r matrix updates. Low functional drift rank does not imply low parameter-update rank. Although the paper correctly states this proviso, no such realization is demonstrated for the MoE backbone. Moreover, Appendix M.4 estimates rank from regime-mean shifts rather than Definition 1’s optimal-map displacement family. The conditional theorem may be valid, but the measured proxy does not establish its applicability. Please construct the realization for the adapted layer, bound any approximation error, and justify the link between the measured and theoretical ranks.
-
The experiments do not test the central memory–error tradeoff under a binding budget. Section 4.1 uses a single chronological 70/30 transition, and Table 6’s zero forgetting follows from retaining the untouched regime-A expert. Section 5 explicitly states that no experiment forces eviction or revisits an evicted regime. Therefore, the study does not establish how covering-based retention controls error when the number of encountered regimes exceeds the expert budget. Please evaluate recurring regime sequences with fewer retained experts than regimes, compare covering-based retention against recency and random retention at equal total memory, and report both current-regime and revisited-regime errors. Moreover, the experiments are conducted on small-scale datasets, and additional experimental results and analysis on large-scale real-world datasets should be provided.
Questions for authors
see weaknesses
2 comments
Response to the authors' reply
Thank you for providing detailed explanation and empirical results, and these results substaintially improve this work. But I think this paper requires another cycle of review since the modifications involve all aspects of theory, methods and experiments.
Response to Reviewer Ww3M
Thank you for a detailed review.
W1 (illustration, motivation). Yes, we added a plain statement of the problem and a map of the results (Section 3 opener).
W2 (W2 vs. MSE). Yes, we took your loss-comparison option; see General Response (GR) 2. Under conditional laws and a fit bound uniform over inputs, Theorem 1's certificate (in d⋆) bounds RMSE.
W3 (Figure 1, Figure 2, Table 7). Fixed. Figure 1 is redrawn as a mechanism diagram with all text at about 9 pt. Figure 2 has uncut axis labels and the key values on the bars. Table 7 is no longer scaled down.
W4 (rank rule on the implemented backbone). On ETTh1, the adapted layer stops improving near the measured displacement rank (new Appendix S).
W5 (binding budget; scale). Yes, we ran the experiment you describe (GR 3c, Appendix T).