- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents MM-TS, a channel structured vision-language model for multivariate time series forecasting. It reuses time-series-derived relation matrices for both vision token construction and attention guidance. In addition, it proposes a structured attention bias to preserve channel-pair identity: local spectral relation and global relation.
With this data preprocessing, all input modalities (text, image, video, numerical) are input to the Qwen3 VL Decoder for multivariate prediction.
Experiments are conducted on eight standard benchmarks and ten additional TIME datasets. The proposed method MM-TS achieves competitive or better performance on both full and limited training data settings.
Critical strengths
This paper models the channel structurals and injects them into the attention bias, providing reasonable design for multivariate time-series forecasting.
- Multi-modal input are extracted and preprocessed for the multivariate time-series forecasting task, including text, patch to image, patch to video, and original numerical time-series.
- The image and video inputs capture cross-channel relation to model the multivariate relationship.
- Structued bias are injected into the attention module of Qwen decoder for prediction.
Better or competitive results are achieved by this method + the strong Qwen3 backbone.
- With the proposed data augmentation and attention bias injection pipeline on top of the strong Qwen3 backbone, it achives better or competitive results on 18 datasets.
Critical weaknesses
The design is simple and relatively straightforward, introducing limited insights and novelty to the time-series and multivariate time-series task.
- Time-LLM already combines text inputs with time-series data and verifies the effectiveness.
- Existing vison-based time-series forecasting models such as VisionTS leverage patched image information for the problem.
- Video information is relatively new in this setting, but extending from image to video is straightforward and simple. There exists video foundation models that can be leveraged for time-series forecasting.
- DMMV [R1] incorporates the vision information + original numerical time-series for the forecasting problem.
Although better or competitive results are achieved, it is unclear whether the improvements come from model design or stronger backbone.
- Existing methods use relatively lighter backbone with smaller parameters, while this paper uses Qwen3 VL as a strong backbone. Qwen3 VL has much larger parameters and memory consumption, thus leading to slower inference. This can be seen from Appendix F.
This is unfair comparison with existing method results.
From Table 3, without the module designs, the bare backbone already achieves strong performance comparable or beat existing methods. Therefore, the better performance of this paper might come from the backbone not model design.
- DMMV [R1] as a related and strong baseline method is not compared in this paper.
[R1] Shen, C., Yu, W., Zhao, Z., Song, D., Cheng, W., Chen, H., & Ni, J. (2026). Multi-modal view enhanced large vision models for long-term time series forecasting. Advances in Neural Information Processing Systems, 38, 93269-93296.
Questions for authors
The questions mainly lie in the novelty of the proposed method, as well as fair comparison with existing methods. Details are listed in above Weaknesses.
2 comments
Thank you for the rebuttal
The authors replied with "not yet found a good solution", "unsure how best to address this issue", and "will read the papers you recommended more carefully".
This indicates that the response does not address the core concerns. Therefore, I will keep my score for this paper.
1. Inference speed is indeed a limitation. However, most of the time is spent converting the time series into images and video, rather than on Qwen3 inference itself. I have not yet found a good solution to this problem.
2. I acknowledge that part of the strong performance comes from Qwen3-VL, which is also why we chose it. We have added further backbone comparison experiments and analysis in Table 4. Your concern that choosing Qwen3-VL may make comparisons with other models unfair is reasonable. However, many recent baselines cannot be adapted to Qwen3-VL, and requiring all comparisons to use Qwen3 would also be unfair. In addition, we have examined papers with publicly available code from conferences such as ICML and found comparisons involving different backbone models, such as GPT-2 and Llama 3. These are not isolated cases. I am therefore currently unsure how best to address this issue.
3. I will read the papers you recommended more carefully.