- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studied long-horizon prediction from multimodal behavioral data and proposed an adaptive multi-scale learning framework for cross-modal fusion under irregular temporal observations. Discriminative features were first extracted. Distillation was used to learn shared representations through cross-modal contrastive alignment. An error-aware adaptive scale router identified the best-suited temporal resolution for final prediction. A clinical dataset and two financial datasets were used to compare the proposed method with baselines.
Critical strengths
- The article is clearly written.
- Although lacking novelty, the methods were well explained, including proper formulation.
Critical weaknesses
- The identified problems are long-standing and have been studied by many groups, generating numerous publications.
- The proposed solutions lack technical innovation, it more of a combination of well-studied existing methods.
- Sections 2.2 and 2.3 are mostly about articles published in 2023 and 2024, lacking newer findings and benchmarks in the field.
- The source of the 300K user dataset is unclear.
- The results need statistical significance reporting. The value-wise improvements over the baselines seem marginal, such as these for the insurance and S$P 500 datasets.
Questions for authors
- The scale selection seems arbitrary. How was the selection made? What were the criteria? Are these the same methods across datasets?
- Since the insurance data is confidential, an explanation/comparison of the three datasets' common and unique characteristics should at least be disclosed to interpret the results.
3 comments
Response to Reviewer T4nY (Part II)
Recent Works
We appreciate the reviewer's comment on the coverage of recent studies and benchmarks in Sections 2.2 and 2.3.
For modality imbalance, IPRM (IJCAI 2025) probes modality strengths and rebalances their learning, while Data Remixing (ICML 2025) reorganizes training samples to alleviate optimization interference. DGL (ICCV 2025) decouples the optimization of modality encoders and fusion modules, and RGM (AAAI 2026) jointly addresses modality imbalance and gradient conflicts. Unlike these optimization-oriented approaches, our DUMT focuses on separating modality-common and modality-specific representations through teacher-guided learning.
For multi-scale temporal modeling, AMD (AAAI 2025) introduces adaptive multi-scale decomposition and predictor fusion, while AdaMixT (IJCAI 2025) dynamically combines multi-scale experts through a gating network. ReIMTS (ICLR 2026) further explores recursive multi-scale representations for irregular time series while preserving their original timestamps. In contrast, our approach integrates multimodal information at different temporal resolutions and uses scale-wise prediction errors to supervise adaptive routing. Recent datasets and benchmarks, including TIME-IMM (NeurIPS 2025) and FinMultiTime (2025), also highlight the importance of multimodal time-series data in real-world applications. FinMultiTime is already used in our financial experiments.
These works provide additional context for positioning our approach within recent developments in multimodal learning and temporal modeling.
Response to Reviewer T4nY (Part III)
Multi-seed Results
We additionally conducted experiments with three random seeds under the 104-week input setting on the insurance dataset to evaluate the stability of the results. The mean ROC-AUC and standard deviation are reported below.
| Method | ROC-AUC ↑ |
|---|---|
| SpecTF | 0.6426 ± 0.0004 |
| TaTS | 0.6126 ± 0.0028 |
| Time-MMD | 0.6533 ± 0.0009 |
| FTS-text-MoE | 0.6373 ± 0.0003 |
| Pathformer | 0.6223 ± 0.0078 |
| TimeMixer | 0.6387 ± 0.0016 |
| Ours | 0.6647 ± 0.0003 |
Our method consistently achieves the best performance across the three runs, outperforming the strongest baseline, Time-MMD, by 0.0114 ROC-AUC on average.
Response to Reviewer T4nY (Part I)
We thank the reviewer for the constructive feedback and positive assessment of the paper's presentation. We address the reviewer's comments and questions below.
Q1. Temporal Scale Selection
We adopt progressively coarser temporal scales {1, 2, 4}, where 1× preserves fine-grained variations, while 2× and 4× provide intermediate and coarser temporal information. This geometric progression offers a compact set of complementary resolutions. As shown in Fig. 2 of the manuscript, 1× performs best among single-scale settings (ROC-AUC 0.6642), while combining {1, 2, 4} improves ROC-AUC to 0.6651, suggesting that coarser resolutions provide complementary information.
We follow the same scale selection principle and use the same predefined scale factors {1, 2, 4} across the insurance and financial datasets, rather than selecting different scales for each dataset.
Q2. Dataset Characteristics and Comparison
All three datasets combine tabular features with textual and numerical temporal sequences, requiring the integration of heterogeneous information over time. The insurance dataset comprises real-world business records of approximately 300,000 policyholders from an insurance company, including tabular attributes and sparse, irregular behavioral sequences derived from expenditure activities. The task is binary prediction of critical-illness claims.
In contrast, the public S&P 500 and HS300 datasets represent the US and Chinese stock markets, respectively, with more regular trading-day observations and continuous-valued forecasting tasks. Thus, the datasets share the challenge of multimodal temporal modeling but differ in observation regularity, application domains, and prediction objectives.