- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the problem of cross-variable dependency modeling in multivariate time-series forecasting. The authors argue that existing methods primarily focus on information routing between variables while overlooking the differences in how different variables express and receive information. To address this issue, the paper proposes FrameMix, which enables variable-specific information interactions by introducing learnable orthogonal transformations for each variable, and integrates it into a patch-based forecasting framework called Frameformer. Experiments on eight public datasets demonstrate that the proposed method achieves competitive forecasting performance on several datasets.
Critical strengths
S1: This paper focuses on the representational differences between variables during cross-variable information exchange and decomposes conventional cross-variable mixing into two components: information routing and variable-specific value transformations. This perspective provides meaningful insights into understanding the effectiveness of cross-variable dependency modeling.
S2: The authors conduct experimental analyses covering different routing mechanisms, orthogonal transformation strategies, fixed and learnable transformations, the respective roles of source and target variables, and model parameter complexity.
Critical weaknesses
W1: The paper mainly conducts comprehensive model comparisons with a prediction horizon of 96. Although Appendix F provides additional results for prediction horizons of 192, 336, and 720, only Frameformer's long-term forecasting results are reported on the PEMSD4 and PEMSD8 datasets, without corresponding results from other baseline models under the same prediction horizons. Therefore, the current experiments are insufficient to demonstrate that the proposed method consistently maintains its advantages across different prediction horizons. In particular, considering that cross-variable dependencies may change with the prediction horizon, comprehensive multi-horizon comparisons are essential for validating the effectiveness of the proposed method.
W2: Although Frameformer performs well on some datasets, its advantages are not consistent across all forecasting scenarios. For example, when the prediction horizon is 720, Frameformer achieves the lowest MSE on only two datasets, with noticeable performance gaps on the remaining datasets. Similarly, at a prediction horizon of 336, it achieves the best performance on only three datasets.
W3: The paper adopts a fixed learning rate of 0.001 and limits the maximum number of training epochs to 15 for all models. However, different models may have substantially different convergence rates and optimal hyperparameter configurations. The authors also explicitly state that the experiments follow a unified training protocol rather than performing independent hyperparameter tuning for each model. Therefore, the current results cannot sufficiently rule out the possibility that inadequate training or suboptimal hyperparameter settings of the baseline models affect the performance comparisons.
W4: Although the paper discusses recent cross-variable modeling methods such as FACT and xCPD in the related work section, these methods are not included in the main experimental comparisons. Considering that these studies also focus on fine-grained variable interactions or cross-variable dependency modeling, they are highly relevant to the research objective of this paper. The lack of direct comparisons makes it difficult to clearly establish the performance advantages and technical differences of FrameMix over recent cross-variable modeling methods.
W5: FrameMix applies orthogonal transformations to both source and receiver variables to enable information transformation between variable pairs. However, the experimental results in Figure 5 show that using only receiver-specific transformations already achieves most of the performance improvements and even outperforms the full model on the Weather and Electricity datasets. This suggests that the performance gains may primarily come from receiver-specific representations rather than the bidirectional composition of source and receiver transformations emphasized by the authors. Therefore, the necessity of the complete pairwise transformation design requires further justification.
W6: Frameformer modulates variable-specific orthogonal transformations across different patch positions to adapt to temporal variations in feature representations. However, Table 14 in Appendix G.3 shows that static transformations and patch-position-modulated transformations achieve nearly identical performance on most datasets, with a noticeable difference only on the Solar dataset. This indicates that the additional patch-position modulation mechanism does not provide consistent improvements in most cases. I hope the authors can further clarify why this design is necessary and explain its unique advantages over simpler static transformations.
Questions for authors
Q1: The authors mention that their experimental setup follows the protocol of CSformer, which in turn adopts the experimental settings of iTransformer. However, some results reported in Table 3 appear to differ substantially from those reported in the original iTransformer paper. I hope the authors can further clarify the reasons for these discrepancies and provide the complete source code, experimental scripts, and relevant hyperparameter configurations to improve the transparency and reproducibility of the experimental results.
Q2: The paper does not sufficiently cover recent advances in multivariate time-series forecasting published in 2026, with some relevant studies and corresponding baseline comparisons missing. I encourage the authors to include more representative recent works and conduct additional comparisons with these methods to provide a more comprehensive evaluation of the novelty and performance advantages of the proposed approach.