- Rating
- 1(−1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1(−1)
- Soundness
- 1
Read review
Paper summary
This paper investigates how fixed length patching may disrupt the structure of ECG heartbeats, with a focus on infant ECG, where heart rates are higher and recording conditions are more challenging. The authors propose BeatGraph, which represents each heartbeat as a graph node and combines waveform morphology and interbeat intervals to learn representations using a Transformer and graph attention. Experiments show that BeatGraph outperforms baseline models on four infant state recognition tasks and demonstrates some transferability to pediatric and adult ECG datasets. The authors also introduce a dataset containing 3408 hours of ECG recordings from 143 infants.
Critical strengths
The research topic is valuable, and infant ECG deserves further investigation. The authors collect long-term infant ECG recordings in natural environments, addressing the limited availability of public data in this area. The model achieves clear improvements across four infant tasks and performs well in cross-age transfer experiments. These results support the potential of heartbeat-level representations for infant ECG modeling.
Fixed length patching may split individual heartbeats across multiple tokens, making it harder for models to learn waveform morphology and rhythm. Previous studies have provided some evidence of this issue. BeatGraph extends this idea to infant ECG, and Table 7 further shows that heartbeat alignment improves downstream performance, providing direct evidence for the design choice.
Critical weaknesses
Motivation. Heartbeat-level tokenization has already been extensively studied. HeartLang [1] proposes using heartbeats as basic representation units, while two studies in 2026 [2, 3] directly examine and validate this approach. Therefore, the central motivation of BeatGraph lacks novelty. The paper also fails to demonstrate that higher heart rates make fixed length patching more problematic for infant ECG.
Model. The model introduces a fully connected GAT after the Transformer, although both components can capture global relationships between heartbeats. While the ablation study shows some benefits from the GAT, the paper does not clearly explain what the graph structure uniquely contributes. This makes the main methodological contribution appear closer to a combination of existing techniques.
Data. The labeled data for three tasks, including sleep, infant state, and activity source recognition, come from only four infants. Although leave-one-subject-out validation is used, the small number of subjects limits the reliability of the results. Furthermore, the emotion recognition task uses experimental phases as emotion labels. The model may therefore be learning differences between experimental conditions rather than the infants' actual emotional states. These issues weaken the claims about the model's applicability in real-world settings.
[1] Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Model, ICLR 2025.
[2] Beat-Synchronous Tokenization for ECG Transformers, arXiv 2026.
[3] On the Role of the Tokenizer in ECG Transformer Models, arXiv 2026.
Although arXiv papers have not necessarily undergone peer review and should be treated with caution, HeartLang explicitly points out that fixed length patching ignores ECG waveform morphology and rhythm structure, potentially affecting representation learning.
Questions for authors
-
Distinction from prior work. Methods such as HeartLang have already adopted heartbeat-level representations. What is the core novelty of BeatGraph compared with these methods? Does BeatGraph still offer an advantage when evaluated on the same infant data with comparable model capacity?
-
Necessity of the graph structure. The Transformer can already model relationships between arbitrary heartbeats. What additional capability does the fully connected GAT provide? Can the authors demonstrate its necessity through more rigorous capacity-matched experiments or an analysis of its underlying mechanism?
-
Generalization and label validity. Only four infants have annotations for three core tasks. Is validation on more independent subjects available? For emotion recognition, can the authors demonstrate that the model learns genuine emotional information rather than differences between experimental phases?
The paper's current presentation is rather weak, with an unconvincing motivation and insufficiently informative experimental results. The authors need to develop a clearer and more coherent narrative and address the concerns raised above. I find the research topic interesting, and I would be willing to raise my score if the authors can address these issues convincingly.
10 comments
Response to reviewer UkBt (2/8)
W1 / Q1. Motivation and distinction from prior work (Continued)
2. Relationship to the two recent tokenization studies
We now cite both [2] and [3], posted on August 31 and September 14, 2026, respectively and consider as our concurrent work. These studies provide useful context for heartbeat-aligned tokenization but address a different methodological question. Study [2] compares tokenizers on adult PTB-XL and Icentia11k and finds beat-aligned tokens comparable to fixed patches. Study [3] examines tokenization as the variable in a supervised study on CPSC2018. Neither investigates infant ECG or introduces the continuous beat-graph encoder and self-distillation framework studied here.
3. Comparisons of BeatGraph with HeartLang, CMSC, and ST-MEM
To examine whether BeatGraph’s gains can be explained by model capacity or access to infant pretraining data, we pretrained a fixed-patch encoder with 30 ms patches and closely matched capacity: 1.40 M parameters versus BeatGraph’s 1.37 M. Both used the same infant corpus and pretraining budget. We additionally pretrained HeartLang, CMSC, and ST-MEM on this corpus. We also report the fine-tuned ST-MEM results from Table 5.
Table R2. Macro-F1 on four infant tasks. BeatGraph’s first three results are from Table 1; affect is evaluated on the released split over five seeds. Fixed-patch, CMSC, and infant-pretrained ST-MEM results use 12 runs for the classroom tasks (four test infants × three seeds) and five seeds for affect. HeartLang uses four test infants × five seeds for the classroom tasks and five seeds for affect. The final row reproduces the fine-tuned ST-MEM results from Table 5.
| Model | Encoder parameters | Sleep/wake | Infant state | Activity source | Affect |
|---|---|---|---|---|---|
| BeatGraph | 1.37 M | 0.923 | 0.589 | <u>0.745</u> | 0.731 |
| Fixed 30 ms patches | 1.40 M | 0.776 | 0.478 | 0.629 | 0.593 |
| CMSC (CLOCS) | 0.05 M | 0.744 | 0.323 | 0.516 | 0.603 |
| HeartLang | 44.5 M | 0.837 | 0.491 | 0.597 | 0.557 |
| ST-MEM, infant-pretrained | 85.1 M | 0.865 | 0.571 | 0.749 | 0.637 |
| ST-MEM, fine-tuned (Table 5) | — | 0.68 ± 0.06 | 0.39 ± 0.04 | 0.52 ± 0.02 | 0.52 ± 0.04 |
These comparisons support four observations.
-
The advantage persists at matched capacity. BeatGraph exceeds the fixed-patch encoder by 0.187, 0.111, 0.216, and 0.178 macro-F1 on sleep/wake, infant state, activity source, and affect, respectively. Matching model size, pretraining data, and budget rules out these factors as explanations for the gains. This comparison supports BeatGraph’s overall beat-centered design, while the component ablations examine individual design choices.
-
Beat alignment alone does not account for the results. BeatGraph outperforms HeartLang on all four tasks by 0.086, 0.098, 0.148, and 0.174 macro-F1, despite using approximately 32 times fewer encoder parameters.
-
BeatGraph remains competitive with a substantially larger infant-pretrained encoder. With approximately 62 times fewer parameters, BeatGraph exceeds infant-pretrained ST-MEM on sleep/wake, infant state, and affect by 0.058, 0.018, and 0.094 macro-F1, respectively, while trailing by only 0.004 on activity source. This supports a favorable performance–capacity tradeoff.
-
The fine-tuned ST-MEM results provide an additional comparison. Relative to the reported means in Table 5, BeatGraph achieves higher macro-F1 on all four tasks, with absolute differences of approximately 0.24, 0.20, 0.23, and 0.21. These results complement the controlled pretraining comparisons above.
Together, the architecture comparison, aggregate metrics, and individual-infant results provide complementary evidence for the benefit of BeatGraph’s continuous beat representations and relational learning framework.
Response to reviewer UkBt (3/8)
W1 / Q1. Motivation and distinction from prior work (Continued)
4. Does higher heart rate strengthen the case for beat-centered representations?
We now substantiate this motivation with complementary evidence from patch alignment, the matched-capacity comparison, and heart-rate-stratified evaluation.
Patch alignment. Median heart rate across the evaluated tasks is 123–132 bpm, corresponding to approximately 455–488 ms between beats. At these rates, moderately long fixed patches can contain multiple R-peaks, while short patches divide QRS morphology across token boundaries. Table R3 quantifies this tradeoff in the infant test recordings.
Table R3. Alignment of fixed patches with detected beats in the sleep and state test windows, whose median heart rate is 123 bpm. QRS overlap is assessed using the interval R ± 40 ms.
| Patch length (ms) | Beats with a patch boundary inside R ± 40 ms | Patches with no R-peak | Patches with ≥2 R-peaks |
|---|---|---|---|
| 30 | 100.0% | 94.0% | 0.0% |
| 250 | 32.1% | 50.3% | 0.0% |
| 500 | 15.7% | 12.9% | 12.3% |
| 650 | 12.2% | 9.9% | 39.1% |
| 1000 | 7.7% | 6.5% | 82.7% |
These statistics do not imply that fixed-patch models cannot learn across boundaries. They demonstrate the segmentation tradeoff motivating beat alignment: shorter patches fragment local morphology, whereas longer patches increasingly combine multiple beats. BeatGraph directly associates each node with a detected beat and separately represents its timing.
Matched capacity. This motivation is accompanied by an empirical advantage: BeatGraph improves macro-F1 by 0.111–0.216 on the three classroom tasks relative to the capacity-matched 30 ms fixed-patch encoder.
Heart-rate-stratified evaluation. We split each task’s test windows at its median heart rate and evaluated both models on identical subsets in paired runs.
Table R4. Macro-F1 in the slower and faster halves of each task. Results are mean ± standard deviation over three seeds, with the four test infants pooled within each run.
| Task | Median HR (bpm) | BeatGraph, slower | BeatGraph, faster | Fixed-patch, slower | Fixed-patch, faster | Gap, slower | Gap, faster |
|---|---|---|---|---|---|---|---|
| Sleep/wake | 123 | 0.913 ± 0.058 | 0.841 ± 0.009 | 0.805 ± 0.056 | 0.709 ± 0.017 | 0.108 | 0.132 |
| Infant state | 123 | 0.512 ± 0.038 | 0.590 ± 0.013 | 0.442 ± 0.010 | 0.450 ± 0.016 | 0.070 | 0.140 |
| Activity source | 132 | 0.795 ± 0.029 | 0.812 ± 0.013 | 0.698 ± 0.023 | 0.619 ± 0.072 | 0.097 | 0.193 |
BeatGraph’s advantage increases in the faster-heart-rate subset for all three tasks, doubling for infant state and approximately doubling for activity source. This pattern is consistent with the proposed motivation. Because heart rate can also covary with behavioral state and signal quality, we interpret this analysis as supporting evidence rather than causal proof that heart rate alone determines the performance gap.
Response to reviewer UkBt (1/8)
W1 / Q1. Motivation and distinction from prior work
We thank the reviewer for asking us to clarify the distinction from prior heartbeat-based methods and substantiate the motivation concerning infant heart rates. Heartbeat segmentation provides a common starting point; the contribution is how these segments are represented, related, and pretrained for infant wearable ECG. BeatGraph’s contribution is a compact representation-learning framework that combines continuous beat representations, explicit inter-beat timing, graph-based modeling, and masked self-distillation for infant wearable ECG. We have clarified this distinction and added comparisons with HeartLang and a capacity-matched fixed-patch baseline.
1. How does BeatGraph differ from HeartLang?
HeartLang is the closest prior work, and we now explicitly discuss and compare against it. Although both methods begin with heartbeat detection, they use the resulting segments differently. HeartLang converts beats into discrete words through a learned codebook and predicts the codebook indices of masked words. BeatGraph represents each beat as a continuous node, incorporates adjacent RR intervals as node features, models relationships between beats through graph attention, and learns by regressing masked-beat embeddings with self-distillation. The distinction therefore extends beyond segmentation to the representation, relational encoder, and learning objective.
Table R1. Comparison with HeartLang (Jin et al., 2025).
Component ablations further support these design choices: the infant-tuned detector in Table 9, explicit inter-beat intervals in Table 7, and the self-distillation term in Table 20.
These choices are particularly relevant to infant ECG. HeartLang pads each beat word to 96 samples at 100 Hz, corresponding to 960 ms. At the infant mean RR interval of 438 ms, a typical midpoint-to-midpoint segment occupies approximately 44 samples, leaving more than half of the word as padding. A QRS complex lasting approximately 60 ms is represented by only six samples at this sampling rate. These observations motivate an adaptive representation that preserves higher-resolution morphology and explicitly encodes timing. HeartLang also identifies limitations involving zero padding under baseline drift and irregular QRS complexes in Appendix B.3, which are relevant to noisy wearable recordings.
The learning objectives differ as well. HeartLang reports that replacing its vocabulary-based target with direct reconstruction is unsuccessful in its setting (Table 3). BeatGraph instead predicts continuous latent embeddings with self-distillation, whose contribution is examined in our Table 20. Our results therefore establish the effectiveness of a different continuous-target formulation that eliminates the separate codebook-learning stage.