- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
MUST is a tokenisation scheme for multi-rate wearable data. Each of nine streams (44 channels) gets its own patch encoder, with patch length matched to the stream’s native rate. The valid tokens are concatenated into one ViT-B sequence over 13-minute windows, with no resampling or imputation of missing patches. Tokens carry positional, timestamp and modality embeddings, and the modality embedding is a frozen Gemini text embedding of a short description. Pretraining uses JEPA (and an MAE variant) on about 3.7B minutes of data from 50k users. Evaluation is by linear probing on activity recognition (5 core and 10 long-tail classes) and on the DWB cohort (five regression and four classification targets, including employment, Medicaid and race/ethnicity), against an “early resampling” version of the same model and a raw-feature baseline. Headline JEPA results are A1 macro-F1 from 0.33 to 0.39, and DWB average r from 0.154 to 0.177 and accuracy from 65.7 to 69.7.
Critical strengths
The setting is realistic and large: real wearable data with genuinely different sampling rates and lots of missingness, pretraining splits by subject, and an evaluation that covers short-window activities and person-level outcomes. A solid answer on how to tokenise multi-rate sensor data would be useful to practitioners. I also appreciated that the authors show where the method loses, such as MAE in Table 2 and Dep/Anx, and flag the accuracy that only equals the majority class.
Critical weaknesses
The experiments don’t show why the method helps. From Fig. 2, the early-resampling baseline puts every stream on a 13-step grid with 1×1 patches, so it differs from MUST in resolution, token count and modality isolation all at once. The paper asks which of these matters (Sec. 5.1) but answers with an argument about a 1 Hz grid that wasn’t actually run. The claims about noise isolation, missing-data robustness and “O(1) routing” have no direct test either. Sec. 5.2 repeats numbers from the main tables with no missingness sweep or baseline under the same dropout, no compute figures are given, and there are no ablations of the components even though the discussion says the ablations “confirm” the claims.
The evidence for the gains is also thin. Results look single-run with no intervals, while many differences are 0.01–0.02 in r. The “consistent, architecture-agnostic” framing doesn’t match the tables: under MAE, MUST is worse on three of four activity metrics in Table 2, and under JEPA it is worse on Age, GAD and Dep/Anx. The only baselines are the authors’ own resampling variant and logistic regression, with no comparison to LSM-2 or the MoE methods in the related work. Person-level labels like age and race/ethnicity are predicted from 13-minute windows, but the paper doesn’t say whether the probe split is by participant. If it isn’t, part of the large Race/Ethnicity gain could be user identification.
Questions for authors
Clarifications:
-
What exactly is the early-resampling baseline (grid, fill method, patch shape, token count), and what are the token counts and compute for both models?
-
For DWB, are probe train and test splits by participant? How many participants, and what are the class counts and majority rates for each categorical target? Please report balanced accuracy or AUROC.
-
Sec. 4.3 uses a 50% target mask for activity and 80% for DWB. Are Tables 1 and 2 from different checkpoints? On what data were mask ratios and learning rate chosen? Where are the combined A0+A1 numbers (0.73/0.75) from Sec. 5.2? Is there a held-out test set for activities, or are results on the validation cohort used for both selection and reporting?
-
Appendix A says DWB is released as de-identified feature aggregations. Can MUST (which needs native-rate streams) be trained or evaluated on the release? What are the provenance, consent and IRB status of the 50k-user pretraining set?
Extra experiments: 5. A controlled ablation separating resolution/token granularity from modality isolation, as described in weakness 1.
-
A missingness sweep and artefact injection into one stream, for both tokenisations.
-
At least one external baseline (LSM-2, or a multi-patch-size time-series model).
Dear authors, we would appreciate your response to the questions raised in our review. We remain open to discussion and would be happy to clarify any of our points. Thank you.