- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
ComPass proposes demand-guided latent compression for high-dimensional time-series forecasting. Rather than compressing every variable uniformly, it estimates how much representation capacity each variable needs and uses that estimate to guide information aggregation into a smaller latent space.
Critical strengths
s1. The paper is well written and clearly organized. The proposed methodology is generally easy to follow, making the motivation, technical design, and experimental evaluation accessible to readers.
s2. The authors address an important challenge in high-dimensional time-series forecasting: how to balance forecasting accuracy, cross-variable dependency modeling, and computational efficiency when the number of variables reaches thousands or even tens of thousands. This is a highly relevant and worthwhile research problem.
s3.ComPass demonstrates promising empirical performance, and the experimental evaluation covers a broad range of benchmarks and analyses. The results suggest that the proposed method has potential for effective and efficient high-dimensional forecasting.
Critical weaknesses
w1. The experimental results do not appear to sufficiently substantiate one of the paper’s central claims: that ComPass adaptively allocates limited representation capacity across variables according to their individual needs. The authors should provide more direct evidence that different variables receive different amounts of effective representation capacity and that such allocation is beneficial.
w2. The paper claims that the proposed compression mechanism preserves key information relevant to forecasting while allocating capacity differentially across variables. However, it remains unclear how this preservation is demonstrated empirically.
w3. It is unclear whether the proposed demand-guided compression mechanism is specific to ComPass or can serve as a general-purpose technique to improve other forecasting architectures.
w4. The scalability study primarily reports the computational cost of ComPass, but does not appear to provide sufficiently comprehensive comparisons with competing methods under consistent experimental settings.
w5. The paper would benefit from a more explicit discussion of its limitations and the conditions under which the proposed approach may be less effective.
Questions for authors
See the Weaknesses.
7 comments
Response to W2: Empirical evidence of forecasting-relevant information preservation.
Thank you for raising this important question. ComPass addresses differentiated capacity allocation and forecasting-relevant information preservation through two complementary mechanisms, which we further validate through variable-level experiments and ablation studies.
(1) Differentiated capacity allocation and forecasting benefits. To verify that the allocated budgets are reflected in actual attention usage, we measure the correlation between variable-wise budget priors and realized attention usage. As shown in Rebuttal Table R, the Spearman correlations are 0.865, 0.989, and 0.994 for the full model on Neurolib, SP500, and Air Quality, respectively, compared with 0.092, −0.168, and −0.160 without . These results show that budget alignment mechanism effectively guides variable-wise capacity allocation.
(2) Budget-conditioned prediction preservation. The auxiliary prediction head generates forecasts from the recovered representations and their corresponding budget embeddings , and aligns them with the target-supervised main forecasts through .
As shown in , removing either the preservation head or its budget embedding consistently degrades forecasting performance. These results demonstrate that explicitly constraining the predictive utility of recovered representations, conditioned on variable-wise budgets, contributes to preserving forecasting information under differentiated capacity allocation.
Together, these results provide empirical evidence. We will incorporate these additional analyses and clarifications into the revised manuscript.
Rebuttal Table R. Spearman correlation between variable-wise budget priors and realized attention usage.
| Dataset | ComPass | w/o |
|---|---|---|
| Neurolib | 0.865 | 0.092 |
| SP500 | 0.989 | −0.168 |
| Air Quality | 0.994 | −0.160 |
Response to W3: The transferability of demand-guided compression mechanism across forecasting architectures.
Thank you for this valuable question. We clarify the applicability of our design and conduct additional plug-in experiments to evaluate its transferability.
To evaluate the transferability of ComPass, we integrate it into two representative forecasting architectures, iTransformer and DLinear. As shown in Rebuttal Table S, incorporating demand-guided compression improves both architectures, achieving lower MSE and MAE than their original counterparts across the evaluated datasets. These results demonstrate that the proposed mechanism can be transferred to different forecasting architectures in high-dimensional settings, rather than being restricted to the specific design of ComPass.
We also want to clarify that ComPass is designed to allocate limited latent capacity according to heterogeneous variable-wise representation requirements, rather than uniformly compressing all variables. We do not intend compression to be universally beneficial. For low-dimensional datasets, directly modeling all variables may better preserve their dependencies without introducing unnecessary information bottlenecks.
Rebuttal Table S. Forecasting results of iTransformer and DLinear with demand-guided compression, MSE / MAE.
| Model | Neurolib | SP500 | Air Quality |
|---|---|---|---|
| iTransformer | 1.718 / 0.347 | 0.511 / 0.306 | 0.447 / 0.431 |
| iTransformer + demand-guided compression | 1.675 / 0.340 | 0.496 / 0.300 | 0.438 / 0.425 |
| DLinear | 1.793 / 0.381 | 0.630 / 0.367 | 0.449 / 0.446 |
| DLinear + demand-guided compression | 1.721 / 0.370 | 0.608 / 0.358 | 0.438 / 0.437 |
Response to W1: Analysis of variable-wise representation capacity allocation and its effectiveness.
We sincerely thank Reviewer 3tTN for the recognition of our work and for providing constructive comments. Below, we address your concerns and questions individually:
We quantify the realized attention usage across variables on Wiki-20k (C=20,000, K=313). As shown in Rebuttal Table Q, the top 10% highest-demand variables receive 50.40% ± 6.40% of the total attention, compared with only 10% under uniform allocation. The total variation distance (TVD) from uniform allocation is 0.449 ± 0.071, further confirming substantial differentiation in the realized attention distribution. These results show that ComPass realizes non-uniform attention allocation, with a substantially larger attention share assigned to the highest-demand variables.
We further compare demand-guided adaptive allocation against uniform and random budget allocation. As shown in Table 2, ComPass consistently achieves lower MSE and MAE than both alternatives across Neurolib, SP500, and Air Quality. These results demonstrate that the performance gains do not simply come from non-uniform allocation, but from allocating capacity according to estimated variable-wise demands.
Rebuttal Table Q. Realized attention allocation compared with uniform allocation on Wiki-20k.