- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper deals with the time series forecasting problem with visual foundation models. It presents PRISM, a training-free model on top of the frozen MAE encoder-decoder.
Two modules are designed: Temporal Chromatic Rendering (TCR) to organize complementary information and RGB directions; Topology-Guided Visual Token Propagation (TVTP) to inject dynamic cross-variable dependencies throught spatilly corresponding latent tokens.
Experiments are conducted on eight standard time-series datasets. Comparisons are made with other pretrained forecasting models such as Timer-XL, VisionTS, etc. Results show that the proposed method beats or in-par-with baseline methods and VisionTS. Albation study and efficiency analysis are also provided.
Critical strengths
This paper raised the Time-Series-to-RGB (TS2RGB) misalignment and proposed a method called PRISM to deal with the misalignement.
- Temporal Chromatic Rendering (TCR) tries to link the temporal information with the MAE patch-embedding coordinate space, making the time-series data more compatible with Visiton Foundation Model.
- Temporal-guided Visual Token Propagation (TVTP) explores and reweights the variables relationship.
The method is training-free, without relying on downstream finetuing.
Experiments show that PRISM significantly outperforms existing non-vision baselines, and slightly outperforms VisionTS (appendix).
- On 12 out of 16 settings (horizon x datasets), PRISM outperforms existing non-vision baselines.
- In Table 7, PRISM slightly outperforms VisionTS.
Critical weaknesses
Although the paper proposes PRISM as a practical and relatively novel method to solve TS2RGB misalignment. The experiments do not strongly support the usefulness, effectiveness, and efficiency of the proposed method.
- This paper mainly tackles the problem from Vision Foundation Models, i.e., TS2RGB misalignment. However, the main results Table 1 compares only with non-vision models. This is both unfair and also less convincing.
- Continue above point, vision-based models are the main comparison baselines in the context of vision-based forecaster. But VisionTS is only compared in the appendix, and the proposed method is only marginal better with sophiscated design.
- From Table 2, it seems that the w/o Both baseline is already qutie strong. Adding the designed TCR and TVTP introduce marginal improvement. Moreover, this result is only on Horizon=720, while main results are average of all horizons.
- In Table 3, the training-free method PRISM is faster than other baselines, but has much higher peak memory, leaving the method less practical in deployment. E.g., it costs at least three times Peak Mem. than baseline.
- Moreover, no comparison with the efficiency of VisionTS.
- Other vision-based forecaster should also be compared.
Questions for authors
Except the baselines in Table 1, what are the other vision-based methods? Why not compare with them?
Why adding TCR and TVTP introduce marginal or no gain in Table 2?
Why VisionTS is only put in the appendix?
Other mentioned points in the above weaknesses.