- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
DTW4TS augments a TS2Vec-style representation learner with reliability-filtered Dynamic Time Warping (DTW) supervision. Candidate neighbors are first selected by DTW distance. Their reliability is estimated from neighborhood overlap and normalized alignment-path deviation, after which selected paths support two training mechanisms: a gated intermediate-layer adapter encoding path geometry and an elastic contrastive objective using cross-sequence temporal correspondences. At inference, the adapter is disabled and each instance is encoded independently.
The paper evaluates classification on 125 UCR and 27 UEA datasets, anomaly detection on five datasets, and forecasting on six datasets. Table 1 reports average classification accuracies of 0.835 and 0.715 for UCR and UEA. Table 2 reports mean anomaly-detection F1 of 0.433 versus 0.385 for SoftCLT. Table 3 reports the lowest overall forecasting MSE, 0.195 versus 0.221 for iTransformer, but not the lowest overall MAE: DTW4TS has 0.292 versus 0.287 for iTransformer (pp. 7-8).
Critical strengths
- A coherent use of alignment information. Reliability selection, path encoding, and elastic supervision address complementary aspects of exploiting DTW relations beyond a scalar distance.
- Broad evaluation with informative controls. The classification archive is substantial. Table 4 includes raw-DTW, individual-reliability-cue, adapter, elastic-loss, and shuffled-path variants. Distance- and rank-conditioned analyses further test whether reliability carries information beyond DTW proximity (p. 9 and Appendix E, p. 17).
- Existing robustness and sensitivity evidence. Appendix F varies the sampled window pool from 64 to 1,024. Appendix G evaluates controlled temporal warping across representative tasks. These are relevant positive results and should not be omitted when assessing the paper (pp. 18-19).
- No alignment machinery at inference. The intended downstream representation is produced by the standalone backbone. DTW distances and paths are constructed using the training split only, and the appendix reports preprocessing, training, inference, and cache costs (Appendices D and H, pp. 16 and 18-20).
Critical weaknesses
- Reliability is a useful heuristic rather than a universal semantic criterion. Large deviations from the diagonal can be valid, and shared-neighborhood consistency may disadvantage rare or isolated patterns. The controlled-warping results mitigate a generic robustness concern, but do not directly measure false rejection of valid relations by class frequency or deformation magnitude. This is a specific remaining question, not a demonstrated failure.
- The adapter mechanism merits additional diagnosis. Table 4 already shows that training with the adapter benefits downstream evaluation after it is removed. It would therefore be inaccurate to imply that useful information has not transferred to the backbone. What remains unclear is how much the backbone relies on the training-time residual, and whether branch dropout or distillation improves the resulting representation.
- Scaling beyond the tested alignment pools remains uncertain. The 64-1,024-window sensitivity analysis and timing table already address practical pool selection. The remaining issue is coverage and preprocessing at substantially larger instance counts or longer sequences. For example, Table 7 reports approximately 890 seconds for pairwise DTW preprocessing on UGLA with 896 instances of length 945, in addition to candidate-path/reliability construction (p. 20).
- The aggregate gains need stronger statistical and task-level interpretation. UCR average accuracy rises from 0.829 for TS2Vec to 0.835, a gain of 0.6 percentage points. Per-dataset paired analyses would clarify robustness. MSL recall of 0.075 is low for several methods, not a unique defect of DTW4TS; it limits absolute application claims rather than refuting the relative improvement. Forecasting gains are stronger in MSE than in MAE.
Questions for authors
- Beyond the existing controlled-warping experiment, how often does reliability filtering discard same-class relations in minority classes or strongly deformed but valid pairs?
- Given the positive backbone-only results in Table 4, can an adapter-branch dropout or distillation experiment diagnose the training-inference interaction? This is a request for mechanism analysis, not a missing baseline already supplied by the paper.
- Do mutual-neighbor selection or an explicitly constrained warping band provide comparable performance at similar pair budgets?
- Extending the reported 64-1,024-window study, how does rare-pattern coverage change for much larger pools or approximate DTW-neighbor construction? Please separate preprocessing time from neural training time.
- Are the classification improvements significant in paired comparisons across datasets, and are forecasting gains robust across both MSE and MAE?
Response to Weaknesses: Reliability and Adapter Consistency
Thank you for your thoughtful review. We address the three weaknesses below and have revised the manuscript accordingly.
W1
We agree that path deviation is a heuristic indicator rather than an exact measure of alignment correctness. DTW4TS jointly considers path deviation and local neighborhood consistency, leveraging their complementary information to guide reliable DTW relation selection.
(1) Empirical Evidence. Figure 5 demonstrates the association between reliability measures and same-class probability, while Table 4 validates their effectiveness in representation learning. We further analyze same-class relation retention across path-deviation quintiles (Appendix E.2). Compared with DTW-only selection, reliability-guided selection increases retention in low-deviation Q1 (+14.39 pp UCR; +27.11 pp UEA) while reducing it in high-deviation Q5 (−19.95 pp UCR; −38.10 pp UEA).
These results support the effectiveness of path deviation as a structural reliability prior for selecting informative DTW relations. We also acknowledge that path deviation may assign lower reliability to legitimate temporal shifts. More precise reliability modeling remains a direction for future work, as noted in the revised Conclusion (line 524).
W2
We agree that sequence-level semantic similarity does not necessarily ensure accurate timestamp-level correspondences. DTW establishes elastic alignments by minimizing alignment costs [1,2]. In DTW4TS, reliability modeling selects reliable DTW relations and their associated paths without modifying the alignments themselves. Thus, the selected DTW correspondences provide fine-grained elastic supervision for learning cross-sequence temporal relationships.
Since ground-truth temporal correspondences are generally unavailable in real-world benchmarks, we provide complementary evidence: reliability analyses (Figure 5; Appendix E) demonstrate the effectiveness of reliable relation selection, while component ablations (Table 4) validate the downstream benefits of DTW-guided temporal learning.
W3
We added two complementary analyses in Section 4.4 (line 485) and Appendix F.
(1) Representation Consistency. We compare adapter-on/off representations using identical inputs and trained checkpoints, evaluating residual ratio, linear CKA, cosine similarity, and RFD. The results show high consistency (CKA: 0.978–0.999; cosine: 0.969–0.998), indicating that the backbone preserves highly consistent representations without the Adapter. Combined with Table 4, these findings support effective adapter-free inference.
(2) Self-Distillation. We further evaluate adapter-to-backbone self-distillation using an adapter-on teacher and adapter-off student with shared backbone parameters. Although distillation reduces RFD on four datasets, the standard strategy achieves better downstream performance on five of six datasets.
These findings indicate that minimizing representation discrepancy does not necessarily translate into better task performance, supporting the effectiveness of our original training-only Adapter design.
[1] Sakoe & Chiba. Dynamic programming algorithm optimization for spoken word recognition. IEEE TASSP, 1978.
[2] Cuturi & Blondel. Soft-DTW: A differentiable loss function for time-series. ICML, 2017.