- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the limitations of existing self-supervised learning methods for time series in event detection and temporal localization tasks. While traditional contrastive learning and masked reconstruction approaches can learn general time series features, they may not effectively capture the occurrence positions, temporal boundaries, and local temporal structures of events. To address this issue, the authors propose Temporal Reversal Discrimination (TRD), which randomly selects a continuous segment from unlabeled time series, reverses it along the time axis, and uses a lightweight linear classification head to predict which time positions belong to the reversed region. This auxiliary task is jointly trained with the original self-supervised objective, encouraging the encoder to learn features related to event patterns, temporal order, and local variations. The additional classification head is removed after pretraining, thus incurring no extra inference cost downstream. The authors integrate TRD into three distinct architectures—TS2Vec, PatchTST, and PMT—and evaluate them on tasks including phonocardiogram recognition, wearable-based action recognition, seismic arrival time detection, and ECG waveform localization. Results show that on the CirCor phonocardiogram dataset, a linear classifier trained with 5% of patient data achieves an improvement of approximately 14–47 percentage points in macro-F1 score for event onset localization; on the OpenPack dataset, the main linear classification setting improves performance by about 2–18 percentage points. Furthermore, in supervised fine-tuning experiments on CirCor, TRD pretraining achieves results comparable to or better than training from scratch, even with fewer labeled samples. The authors also analyze the impact of supervision granularity and temporal perturbation strategies on representation learning by comparing with Dense Localization, Window-level Reversal Classification, and Block Shuffling. Overall, this work demonstrates that a simple local temporal reversal localization task can enhance the ability of existing self-supervised encoders to represent real-world event temporal structures, particularly benefiting event detection and localization scenarios with limited labeled data.
Critical strengths
Strength 1. TRD does not require modifying the original encoder architecture, nor does it rely on additional event annotations. It can enhance the pre-training target merely through local time reversal and lightweight auxiliary classification headers. The author verified the method on three different structures, namely TS2Vec, PatchTST and PMT, indicating that it has certain architectural adaptability. Strength 2. It performs outstandingly in low-labeled data scenarios. In the CirCor experiment, TRD achieved a 14-47 percentage point increase in Linear Probe Macro-F1 under a 5% training patient setting. The supervised fine-tuning experiment further indicates that a small amount of labeled data combined with TRD pre-training can achieve or exceed the results of de novo training with more labeled data, demonstrating strong data efficiency. Strength 3. This work not only tested End-to-end Fine-tuning, but also froze the Encoder, evaluated the feature quality using Linear Probe and Temporal Classifier, and compared it with paired random seeds and different annotation budgets. This helps to distinguish the impact of the quality of pre-trained representations on the learning ability of downstream models.
Critical weaknesses
Weakness 1. The method's innovation is relatively limited. Time reversal, temporal order prediction, and local perturbation detection have all appeared in existing self-supervised learning research. The main distinction of TRD lies in combining local time reversal with token-level dense classification as an auxiliary pretraining objective. Although the experimental results are valuable, the paper still needs to further clarify its unique contributions compared to existing methods such as Temporal Order Prediction, Dense Corruption Detection, and AnomalyBERT. Weakness 2. The model may learn artificial artifacts from perturbations rather than genuine event semantics. TRD constructs training samples by reversing local signals and smoothing boundaries via crossfade, which could lead the model to rely on reversed boundaries, statistical changes in signals, or artificially generated features from crossfade to identify reversed regions—without necessarily understanding the true temporal direction or physiological meaning of events. The Discussion section also acknowledges that the contribution of temporal direction itself has not been fully disentangled from interval insertion and crossfade cues. This is, in my view, the most critical methodological issue. Weakness 3. Performance improvements lack consistency across datasets and models. While performance gains on CirCor are highly significant, certain temporal classifier settings on OpenPack show degradation, and TS2Vec’s average F1 score on LUDB drops from 58.83% to 54.01%. Moreover, block shuffling outperforms temporal reversal in multiple TS2Vec configurations. This suggests that temporal reversal may not universally be the optimal self-supervised task, and the method’s effectiveness might heavily depend on data characteristics and encoder architecture.
Questions for authors
Temporal reversal, temporal-order prediction, and dense corruption detection have been explored in prior self-supervised learning studies. Could the authors clarify the main methodological novelty of TRD compared with existing approaches such as AnomalyBERT, temporal-order prediction, and dense temporal localization methods? In particular, what distinguishes the proposed reversal-localization objective beyond combining existing temporal transformations with token-level binary classification?
Response to Reviewer 6hAc
Thank you for the careful review. The general response above summarizes the contribution and the revision; below we answer your points directly.
W1 and the question, novelty. One plug-in objective, added unchanged to three existing encoders, makes them much better event encoders, and the approaches you name do not do this in our experiments. The revised introduction now states this claim and places TRD among per-position manipulation-detection objectives.
The new controls also show what the objective needs: content moved out of its temporal order, and no cheaper cue that marks the interval (W2). We are not aware of these results in prior work on reversal or order pretexts for time series.
W2, artefacts or event semantics. The encoder is not relying on artefacts; the gain comes from reordered content. The submission left this open, and new Section 4.3 tests it.
The Discussion sentence you quote now reports this result.
W3, consistency and shuffle. The gains are consistent for PMT and PatchTST on all four datasets; the exception is TS2Vec on OpenPack and LUDB. Section 3.2 now names this exception and points to its causes. PMT improves in 42 of 42 paired test comparisons and PatchTST in 38 of 42. The LUDB drop you quote for TS2Vec (58.83 to 54.01) uses classifiers trained for 40 updates; with 400, TS2Vec gains 7.5–11.2 points at every label budget (Section 3.2, Table D.9). On OpenPack, TS2Vec needs longer blocks: order-only reversal gains 0.7 points with 1 s blocks and 21.8 with 4 s blocks (validation; Section 4.3, Table E.10).
Shuffle's lead on TS2Vec fits the account in Section 4.3, and Section 4.2 and the abstract now present it this way. Shuffle is one of our controls, and it reorders content, which Section 4.3 identifies as the source of most of the gain. On TS2Vec, order-only reversal, which reorders blocks and plays each forward, also beats TRD, by 10–13 points with blocks of 100 ms or longer (Table 5). The paper's claim is that the objective improves each encoder's own pretraining, which holds in all 18 primary comparisons.