- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes DAMIE, a memory-efficient architecture for long-term multivariate time-series forecasting. The paper introduces Step-Indexed Completion (SInC), a design criterion that enables cross-axis modeling within a single-axis computational budget while preserving native-axis-level alignment. DAMIE instantiates SInC through a shared temporal memory and Flip Attention, allowing each target variate to selectively aggregate information from individual time steps, together with Taylor-form residual completion for further refined representations. Experiments across multiple datasets and forecasting horizons show that DAMIE achieves strong overall forecasting performance compared with existing multivariate time-series forecasting baselines while demonstrating memory efficiency.
Critical strengths
S1. Memory-efficient cross-axis modeling. DAMIE enables effective cross-axis modeling within a single-axis budget by combining a shared temporal memory with Flip Attention. The efficiency results in Section 4.3 (Q1) show that this design substantially reduces memory consumption compared with existing multivariate time-series forecasting baselines. It provides a practical way to capture both temporal and cross-variate dependencies without the memory cost of explicit two-axis modeling.
S2. Robust forecasting performance. DAMIE achieves the best overall forecasting performance across diverse datasets and prediction horizons, compared with both Transformer-based and non-Transformer baselines. It also remains robust across different combinations of lookback-window and prediction-horizon lengths. (Section 4.3, Q2) Together, these results suggest that its gains generalize across forecasting settings rather than depending on a particular dataset, horizon, or input length.
Critical weaknesses
W1. Incomplete empirical comparison and scaling analysis. The main comparison omits several recent and relevant long-term forecasting methods, such as TimeMixer and TimeFilter. This makes it difficult to determine whether DAMIE’s reported gains persist against stronger baselines. Moreover, the paper does not provide a controlled analysis of how its accuracy and efficiency scale with the variate dimension although the proposed cross-axis coupling can explicitly depend on the number of variates.
W2. Limited evidence for the generality of SInC. DAMIE is evaluated only in the time-major configuration, where the time axis forms the shared memory and variates serve as targets. The paper therefore provides limited evidence that the proposed principle generalizes to alternative axis choices.
Questions for authors
Q1. Could you compare DAMIE with more recent long-term forecasting baselines, particularly such as TimeMixer and TimeFilter? Results for both forecasting accuracy and memory efficiency would materially strengthen the empirical claims. Please refer TSlib, which is the github repository including a lot of recent long-term forecasting baselines.
Q2. Could you evaluate a variate-major counterpart in which the variate axis forms the explicitly indexed shared memory, under a matched parameter and computational budget?
Q3. How do DAMIE’s accuracy, memory consumption, and runtime scale with the number of variates? A controlled experiment that varies the variate dimension while holding the temporal setting and other properties fixed would help establish whether the claimed efficiency and effectiveness persist in both low- and high-dimensional settings.
4 comments
Thank you for the detailed responses and additional experiments. They helped address several of my concerns.
However, the Q2 results leave me uncertain about how broadly SInC can be instantiated with different choices of explicit axis. Furthermore, although the suggested method, DAMIE, demonstrates effective forecasting performance, it still appears to combine several established components in a relatively complex architecture, so my concern about its methodological distinctiveness remains.
For these reasons, I will maintain my score.
Generality
The generality of SInC does not rely on instantiating multiple models, but on its architecture-agnostic abstraction of cross-axis information transfer under a single-axis budget (section 2). Through the View–Weights–Readout interface, it formalizes the trade-off between native time-step resolution and cross-axis interaction cost as an explicit design constraint. DAMIE is a concrete Transformer-style implementation following this principle.
Clarification.
We cite iTransformer and RLinear to draw on prior studies demonstrating the effectiveness of variate-level representations ((N\times D)) in multivariate time series forecasting. Accordingly, the performance differences between Variable-Major and Time-Major should also be understood in light of their output representations. The (N\times D) variate-level output representation is also an important factor influencing these differences, providing a theoretical rationale for choosing Time-Major.
Note: These models are cited solely as related work and external baselines; their components are not incorporated into DAMIE.
We hope this clarification can address the your concerns.
Thank you for the clarification.
I understand your points, but my concerns remain. I will maintain my weak acceptance recommendation.
Response to Reviewer 3
We thank the reviewer for the thoughtful questions and constructive feedback.
Q1. Additional Baselines
We further compare DAMIE with TimeMixer and TimeFilter on both low- and high-dimensional multivariate time-series datasets.
The computational results are reported as Size (Time), measured in GB (s/iter).
DAMIE outperforms TimeMixer across all three datasets and achieves comparable forecasting accuracy to TimeFilter. In efficiency, DAMIE achieves substantial memory and runtime savings on the high-dimensional datasets.
These results demonstrate DAMIE's favorable trade-off and validate the effectiveness of explicit cross-axis alignment under a single-axis budget. We have also included recent competitive models, including SOFTS, S-Mamba, and TimePro, in our baseline comparisons (In the main result and appendix).
Q2: Indexing Order
In theory, prior studies suggest that variate-token (N×D) representations are well suited to Transformer-based forecasting architectures (e.g., iTransformer).
Experimentally, We design and evaluate a Variable-Major indexing scheme. Under matched parameter counts and computational budgets, we compare Variable-Major (encoder outputs L×D) and Time-Major indexing (encoder output N×D).
The results show that Time-Major indexing achieves the best forecasting performance. This suggests that Time-Major indexing organizes temporal information more effectively within Transformer-style architectures, consistent with the itransformer conclusion.
Therefore, shared-memory indexing affects not only information access and interaction patterns but also forecasting performance, making Time-Major indexing a more effective choice for DAMIE.
Q3. Scalability Analysis
DAMIE models interactions across both variate (N) and temporal (L) dimensions. We therefore evaluate its forecasting performance and computational efficiency along both dimensions.
(1) Variate Dimension. *Directly varying the number of variates within a dataset disrupt existing inter-variate dependencies and affect forecasting results. * We therefore evaluate datasets with different variate dimensions: ETTh2 (N=7), ECL (N=321), and Traffic (N=862). We use iTransformer as the baseline under identical settings.
The computational results are reported as Size (Time), measured in GB (s/iter).
The main forecasting results show that DAMIE achieves better accuracy than iTransformer. In efficiency, DAMIE incurs lower memory consumption and runtime on high-dimensional datasets, demonstrating favorable scalability with increasing variate dimensions.
(2) Temporal Dimension (L). We further evaluate computational efficiency across different lookback lengths, using a standard Transformer with the same configuration as the baseline on ETTh2.
DAMIE consistently incurs lower memory consumption and runtime as the lookback length increases, demonstrating favorable scalability along the temporal dimension.
*Theoretical Analysis. These results are consistent with the interaction complexity (in Table 12). DAMIE adopts a constrained interaction structure to reduce computational and memory overhead, enabling favorable scalability along both dimensions.