- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents Latent Inference-Time Guidance for Time Series Foundation Models (LITiG-TSFM), a probabilistic framework for combining and correcting predictions from frozen, pre-trained Time Series Foundation Models (TSFMs) without retraining them. The core idea is to frame TSFM ensemble forecasts as observations generated by a structured state-space model governed by time-dependent latent variables with independent components, leveraging concepts from nonlinear Independent Component Analysis (ICA).
Critical strengths
The paper introduces a creative bridge between nonlinear ICA (they refred to -SNICA ) and inference-time ensembling of time-series foundation models. Th e core comtribution is to frame forecast combination and correction via independent latent components () without modifying the underlying frozen foundation models which represent a novel direction for zero-shot forecasting.
Critical weaknesses
I noticed a confusion between theoretical bounds and formulation presented in section 3, they defined a backward-factorised variational posterior and evaluate backward variational smoothing kernels (we read in Assumption B3 and Proposition 3.2). However, Appendix A.1 derives the ELBO but when I look at Appendix A.2/Section 5 (in Discussion) they describe implementation using a FORWARD factorisation . They admit: "Whilst we use forward factorisations of the time series when implementing LITiG-TSFM, the reconstruction guarantee is given in a backward factorisation". I think there is a misconception of teh framework or there is something unclear is not disclosed here, because the optimization objective maximized during training does not match the backward variational family used in Proposition 3.2, the theoretical reconstruction guarantee does not apply to the actual proposed algorithm.
Also I think there is typos: The sum over transition distributions has terms, but line 790 writes instead of . In addition, the final explicit ELBO formula duplicates and cancels inconsistent terms with mismatched indexing bounds ( vs ).
Questions for authors
On the mismatch of theory vs implementation, could you explain why the forward-factorized variational posterior was implemented in practice if the stability guarantee (Proposition 3.2) requires a backward-factorized variational family? Can you provide proof that Proposition 3.2 holds under the forward variational posterior used in your ELBO code? For the ELBO Derivation Correction defined In Appendix A.1 (lines 810-834), how are the sign errors in the quadratic log-Gaussian variational density reconciled, and what is the exact closed-form expression implemented in your loss computation?
On the mismatch of theory vs implementation, could you explain why the forward-factorized variational posterior was implemented in practice if the stability guarantee (Proposition 3.2) requires a backward-factorized variational family? Can you provide proof that Proposition 3.2 holds under the forward variational posterior used in your ELBO code?
We thank the Reviewer for pointing out the discrepancy between the theoretical and implemented factorisations. We chose to write Proposition 3.2 with a backward-factorized variational family to extend some recent theoretical results to our setting. The forward factorisation was chosen for simplicity in our step-wise forecasting setting. Thanks to your comment, we propose to extend the theoretical analysis of our work and to provide the conditions under which the stability result can be extended to the forward-factorized variational family. This can be done using similar forgetting properties on the forward Markov chains. We will therefore adjust the scope of Proposition 3.2 to cover both forward and backward settings.
For the ELBO Derivation Correction defined In Appendix A.1 (lines 810-834), how are the sign errors in the quadratic log-Gaussian variational density reconciled, and what is the exact closed-form expression implemented in your loss computation?
We thank the Reviewer for checking the derivation of the ELBO. The typos in the manuscript are not reflected in the implemented version, and will be corrected in the implementation for future versions of the manuscript.