- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper investigates how to allocate a fixed data budget between the number of participants and the number of PPG segments per participant for contrastive self-supervised pretraining. Using a cohort of 114K participants and over 200 pretraining runs, the authors show that increasing participant diversity yields greater benefits than collecting more segments per person. They further derive a two-axis scaling law and propose a budget-adaptive data acquisition strategy, validated through controlled experiments and downstream demographic prediction tasks.
Critical strengths
Practical research question.The paper addresses a relevant data allocation problem in physiological signal pretraining, examining the trade-off between recruiting more participants and collecting more segments per participant. Extensive empirical validation.The study conducts over 200 pretraining runs with controlled data budgets and proposes a two-axis scaling law. The experimental design provides quantitative evidence for data allocation decisions, although the broader generalizability remains unclear.
Critical weaknesses
W1. Limited generalizability. The proposed scaling law is primarily validated on a single PPG cohort using person-identity contrastive learning. Its applicability to other datasets, signal modalities, and self-supervised learning objectives remains unclear. W2. Potential evaluation bias. The main conclusions rely on demographic prediction tasks (age, BMI, and sex), which are naturally correlated with person identity. It is unclear whether the observed gains reflect general representation quality or alignment between the pretraining objective and downstream evaluations. Stronger validation on clinical tasks is needed. W3. Simplified data acquisition budget. The formulation (B=K\times M) assumes equal acquisition costs per segment, without accounting for the additional costs of recruiting new participants. This may limit the practical applicability of the proposed allocation strategy. W4. Insufficient validation across pretraining strategies. Although several SSL objectives are compared, the scaling analysis focuses on identity-contrastive pretraining. Additional experiments with alternative SSL objectives would help establish whether the observed scaling behavior is specific to the chosen training strategy.
Questions for authors
refer to the weakness
2 comments
Follow-up to Reviewer 9otM
We thank Reviewer 9otM for continuing to follow the discussion; we noticed that the review was recently edited. As the discussion period ends today and the listed weaknesses refer to the original submission, we briefly summarize how the revision addresses each.
W1: limited generalizability. We agree that one pretraining cohort cannot establish a general law, and the paper frames the result as a regularity of identity-contrastive PPG pretraining in this setting. Within that scope, the ordering holds on a separate cohort of 1,034 people (Section 5.4), across four backbone families of matched size (Appendix D.3), and across three model sizes (Appendix D.2).
W2: potential evaluation bias. We added a target that is not tied to identity: within-person blood-pressure changes, with each person's mean removed so that recognizing the person no longer helps the probe. The people-heavy allocation leads at every budget (Section 5.4).
W3: simplified data acquisition budget. The paper now states that the budget counts segments only (Sections 1 and 3), and the allocator includes a per-person recruitment cost: a higher cost shifts the optimum toward fewer people with more segments each (Appendix E.8).
W4: insufficient validation across pretraining strategies. Under a masked autoencoder the allocations tie (Appendix B.1), so the paper now states its claim for identity-contrastive pretraining only. This scope covers the objective one would choose: identity-contrastive training gives the highest clinical AUC of the seven objectives we compared (Table 5).
We hope this resolves the reviewer's concerns. If any remain, we would be glad to discuss them before the discussion period ends; if not, we would be grateful if the assessment could reflect the revision.
Response to Reviewer 9otM
We thank Reviewer 9otM for the review and the clearly separated weaknesses, which we address in turn. All revisions are highlighted in blue in the revised PDF; those for this review are in Sections 1, 3, 5.4 and 7, and Appendices B.1, C.3, D.3 and E.8.
W1: Limited generalizability.
We agree that one pretraining cohort cannot establish a general law. The paper frames the result as a regularity of identity-contrastive PPG pretraining in this setting, and lists other cohorts, devices and modalities such as ECG as future work. Within that scope, the evidence now extends in three directions.
Other objectives are covered in W4.
W2: Potential evaluation bias.
We agree that age, BMI and sex are tied to identity, so we added a target that is not: within-person changes in blood pressure on a separate cohort of 1,034 people, with each person's mean removed so that recognizing the person no longer helps the probe (General Response §1; Section 5.4, Appendix C.3).
The people-heavy allocation tracks these changes better at every budget for both SBP and DBP, by +0.019 to +0.055 in within-person correlation, and every 95% confidence interval of the gap excludes zero. The people-heavy allocation at 0.3M even matches or beats the segment-heavy allocation at 3M. The allocation ordering is therefore not limited to the demographic targets. On the clinical tasks the reviewer asks for, the existing labeled subsets (34 to 510 people) are too small to rank allocations, which is why we added a cohort with many blood-pressure readings per person.
W3: Simplified data acquisition budget.
This is a fair point. Sections 1 and 3 now state that B counts segments only, and Appendix E.8 adds a per-person recruitment cost to the allocator. A higher recruitment cost shifts the optimum toward fewer people with more segments each: slightly while recruitment is cheap relative to recording, and strongly once the two are comparable.
W4: Insufficient validation across pretraining strategies.
We trained the 1M diagonal with a masked autoencoder (Appendix B.1). The allocations tie, so the people advantage, the exponents and the allocator are specific to identity-contrastive pretraining, and the abstract and Discussion now state this scope. In our experiments, a people-heavy allocation is not worse beyond seed noise under either objective. Identity-contrastive training also has the highest clinical AUC of the seven objectives we compared (Table 5), so this scope covers the objective one would choose.
Summary
The within-person blood-pressure task on a separate cohort of 1,034 people shows that the allocation ordering holds beyond identity-linked traits. We hope these results address the reviewer's concerns and are glad to answer any further questions.