- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
W-JEPA proposes wavelet-based tokens for self-supervised wearable activity recognition. The paper uses wavelet mean/RMS statistics as tokens for JEPA pretraining, then fine-tunes the model for wearable activity recognition. It evaluates on six datasets, with the target dataset excluded from pretraining and participants separated in the main downstream evaluation.
Critical strengths
I like the evaluation setting. Leaving the target dataset out of pretraining and testing on unseen participants makes the results more relevant to actual use. The gains are also quite good.
The paper is easy to follow. Rerunning the baselines with common preprocessing, splits and seeds is a good effort. The raw-patch ablation is useful too, since token count and embedding MLP depth/width are matched. The restricted-sensor experiments provide additional evidence that the approach works beyond the full-sensor setting.
Critical weaknesses
-
The novelty seems mainly in how the tokens are constructed and masked. Using wavelet statistics as prediction units is a reasonable idea, but wavelet features for time-series are already established (e.g., Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenization, Learning filter widths of spectral decompositions with wavelets), and the JEPA framework itself is largely standard. This also makes the missing training from scratch comparison important. Since all downstream results use end-to-end fine-tuning, could the same wavelet model already get similar results without pretraining?
-
The wavelet tokens contain mean and RMS, while each raw token contains 50 ordered samples. So this comparison changes both the frequency decomposition and how much information is summarized. It shows that the complete tokenizer is useful, but doesn’t tell us which part matters most. I’d like to see a simple temporal mean/RMS tokenizer without wavelets.
-
do the five seeds change the participant split, or just training randomness? Three datasets use only two participants for finetuning, so the choice of participants could matter quite a bit. These details need clarification before I can be confident about the comparisons. I’m not saying the baselines were treated unfairly, bur the paper just doesn’t give enough information to check this
Questions for authors
see above
Thank you for the thoughtful review. We ran the component analyses you requested and documented the baseline setup, and every result confirms that each design choice in W-JEPA is justified and that the full model is strongest. All of these results will be added to the revised paper. Based on the strong results we present, we kindly ask you to consider raising your score.
1. Is JEPA pretraining necessary? Yes. W-JEPA is built to unify heterogeneous wearable data across sensors, body locations, and populations, and JEPA’s latent prediction is designed exactly for this: it learns structure shared across sources rather than sensor-specific detail. The results confirm it. On the same wavelet tokens and participant splits, JEPA pretraining beats training from scratch on all six datasets:
Subject-disjoint macro-F1 (%), mean ± SD
JEPA also beats a matched Wavelet MAE on all six datasets (see table). Prior work uses wavelets differently: WaveToken quantizes coefficients for forecasting (Masserano et al., 2025), and Khan and Yener (2018) learn wavelet filter widths for classification. Our contribution is using wavelet tokens indexed by scale, sensor axis, and time bin as units of masked latent prediction for wearable signals. Motivation and evidence together confirm that JEPA pretraining is necessary.
2. Does each part of the tokenizer contribute? Yes. We follow your suggestion and separate frequency decomposition from pooling. With the same mean/RMS statistics, wavelet tokens beat temporal summaries by 5.81 points and score higher on all six datasets, so frequency decomposition matters most. Raw DWT coefficients already improve over raw temporal patches by 6.20 points, and mean/RMS pooling adds a further gain on five of six datasets. The full tokenizer remains strongest.
Subject-disjoint macro-F1 (%) for W-JEPA variants, mean ± SD
3. Participant partitions and seeds. For each dataset, every method is evaluated on the identical participant partition, so no method benefits from a favorable split; the five seeds measure training variability on each partition. The target dataset is excluded from pretraining, so the held-out participants are unseen in both stages. We will state the this protocol explicitly in §4.1 .