- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper addresses the problem of learning multivariate dependence in time-series models, where many current approaches operate under a channel-independence assumption. Unlike existing methods that adapt channel-independent models to multivariate settings by jointly learning marginal forecasting and multivariate dependencies, which can lead to a degradation in marginal performance, CopuAdapt exclusively focuses on recovering the missing multivariate structure by augmenting pre-trained, frozen time-series models with a learned multivariate dependence model.
The proposed end-to-end system includes five main components: (1) a frozen, pre-trained backbone that provides the channel-independent forecasts; (2) an encoder that processes the history window per channel and pools it using attention-based pooling to produce a global descriptor per variable, providing context for the dependence learning components and supervised via a Joint Embedding Predictive Architecture (JEPA)-inspired objective to predict representations of the future context from history representations; (3) a residual feedforward network that predicts features used to estimate pairwise edge probabilities in a directed acyclic graph, dictating which other variables' forecast values each variable can condition on; (4) an attention-based, graph-conditioned copula generation module that models joint dependence per variable by re-ranking samples; and (5) a non-parametric ranker that restores coordinate-wise empirical marginals so they remain identical to the underlying TSFM, transferring only the rank dependence structure.
The method is evaluated against two baselines, AdaPTS and ICA, across four time-series foundation models (Chronos, Moirai2, Sundial, and TiRex). CopuAdapt is shown to better preserve marginal forecasting accuracy, achieving substantially lower CRPS compared to AdaPTS and ICA, while showing a marginal degradation compared to the base model observed only for Chronos. It also improves metrics that measure joint modeling, such as the Variogram Score (VS) and RBF-MMD compared to AdaPTS and ICA. The proposed adapter adds roughly 0.7% to 8.5% additional parameters relative to the benchmarked base model backbones.
Critical strengths
- A novel approach to multivariate dependence learning in time series that decouples marginal forecasting from dependence modeling.
- The method is shown to substantially better preserve marginal forecasting accuracy compared to existing multivariate adaptation baselines while achieving superior (lower) VS and RBF-MMD scores.
Critical weaknesses
- The paper, and particularly the method section, is difficult to follow and digest, which obscures the paper's core contributions.
- The ablation studies are relatively limited given the complexity of the five-component pipeline. In addition, while the adapter is lightweight relative to large foundation models, it introduces more parameters than compact, strong architectures like PatchTST or TimeMixer. The paper does not clarify why the framework was not evaluated on such models.
Questions for authors
- Can the authors please provide a concise summary of their pipeline, with a particular focus on (a) the motivation and assumptions underlying the design on each component (b) input, output and purpose
- Can the authors please provide ablation studies isolating the contribution of each key design choice across the five proposed pipeline components?
- Have the authors considered or evaluated applying their method to smaller yet highly competitive architectures (e.g., PatchTST, TimeMixer)?
Post-rebuttal: The authors have thoroughly addressed my concerns by providing a per-component ablation study that clarifies each module's contribution, along with additional baseline comparisons that align well with the results reported in the original submission. I am raising my score from 2 to 3 accordingly.
2 comments
I thank the authors for their response. They have thoroughly addressed my concerns by providing a per-component ablation study that clarifies each module's contribution, along with additional baseline comparisons that align with the results reported in the original submission. I will raise my score accordingly.
We thank you for noting the novelty of our approach, our substantial improvement in marginal preservation, and superior performance on VS and MMD.
Concise pipeline summary: motivation, assumptions, inputs, outputs and purpose of each component.
We will add the following summary of the five components to Section 4.
Additional Ablations isolating core components.
Compact architectures.
We now evaluate CopuAdapt on PatchTST, using the official implementation and per-dataset hyperparameters with a 19-quantile output head (levels 0.05 to 0.95).
CopuAdapt significantly improves every dependence metric over PatchTST-Q, with CRPS identical by construction:
All Holm-corrected p<1e-5. Results cover 27 of the 28 cases; weather H192 is still training and will be added. As with Chronos, trajectory-aware restoration is clearly better than per-step (+13.6% MMD, +2.4% TVS, +0.8% VS; p<1e-5).
We thank you for your thorough review improving the clarity and empirical rigour of our work. We hope our reply has clarified our proposed approach, demonstrated the value of our method even on a learned in-domain backbone, and that in light of this you consider raising your score and supporting our acceptance.