- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
KDPPG uses knowledge distillation to train a streaming rPPG model. A clip-based teacher incorporates facial masks and PNCC geometry features to reduce interference from lighting and motion. The student receives supervision from both the teacher’s features and predicted waveforms. It combines Mamba-2 with a parallel harmonic resonance module (PHRM) and processes incoming frames while maintaining temporal states. Experiments cover four datasets, two cross-dataset settings, component ablations, and computational profiling. The reported results show that the student achieves accuracy close to the teacher without requiring its auxiliary priors at inference.
Critical strengths
- The teacher combines explicit background and geometry cues to address two relevant sources of interference. DPRM uses a facial mask to separate face and background features, subtracts pooled background features as an interference reference, and incorporates PNCC geometry through cross-attention. These are concrete additions to the teacher design. In Tables 3–4, removing the mask or PNCC increases MMPD MAE from 2.731 bpm to 3.611 and 3.414 bpm, respectively. These results support the usefulness of the priors for improving the teacher and providing a stronger source of supervision.
- The student introduces explicit oscillatory dynamics alongside Mamba-2 for periodic signal modeling. PHRM uses learnable damped rotations to update its states and combines its output with the Mamba-2 branch through a learned gate. This gives the recurrent student a direct mechanism for representing physiological rhythms. Table 5 shows a corresponding improvement: MMPD MAE decreases from 3.45 to 2.95 bpm, while correlation increases from 0.79 to 0.86. This is the clearest evidence for a useful architectural contribution in the student.
Critical weaknesses
- The contribution beyond KDPhys is not sufficiently established. KDPhys already transfers spatiotemporal representations from a 3D CNN teacher to a lightweight 2D CNN student for rPPG. KDPPG introduces teacher priors, a causal recurrent student, and PHRM, which are potentially meaningful extensions. However, the paper neither discusses this closely related work nor provides comparisons that establish the value of these extensions. The teacher ablations show that priors improve the teacher, while the PHRM ablation shows that the periodic branch improves the student. Neither isolates the benefit of transferring prior-guided representations. Figure 8 also changes teacher architectures rather than isolating the priors. Without a matched student trained without distillation and a controlled comparison of teacher priors, I cannot determine how much of the improvement comes from the proposed distillation framework.
- The evidence for low-latency physiological measurement is incomplete. Producing a waveform sample for each frame does not establish how soon a reliable HR estimate becomes available. Appendix D does not specify whether Butterworth filtering is causal or how much signal Welch estimation requires. The efficiency results also compare one-frame and 160-frame forward passes, with clip-based methods repeatedly processing stride-one windows. This is a relevant setting for frequent updates, but the advantage depends on that update policy. The paper needs to establish its accuracy and latency under a complete causal pipeline and a comparable output schedule, since streaming deployment is a central claim.
Questions for authors
- Clarification of the contribution: What capability does KDPPG add beyond KDPhys? Please distinguish the contributions of teacher priors, the causal student, and PHRM, and identify which existing experiments support those distinctions.
- Controls needed to assess the central claim: Can you report results for the same student trained without distillation, and for distillation from the same teacher with its priors removed? These controls would help determine whether the gains require prior-guided knowledge transfer or mainly follow from the student architecture and teacher quality.
- Clarification and validation of streaming evaluation: Were Tables 1–2 obtained through sequential inference with persistent states and past-only processing? Please specify state resets, the filtering implementation, and the HR estimation window. Under that pipeline, how does HR error change with elapsed observation time, and does the efficiency advantage remain at a matched output refresh interval?
4 comments
Response to Reviewer W2QH (Part 2/2)
3. Causal evaluation and HR observation time (W2 & Q3)
For a fair comparison with existing methods, Tables 1–2 follow the full-video HR evaluation protocol used by rPPG-Toolbox. The student resets its states at the beginning of each 128-frame clip, then processes frames sequentially and outputs one rPPG sample per frame. The predicted waveforms are concatenated chronologically, and HR is estimated from the assembled prediction and the reference PPG of the same length using identical postprocessing. Thus, 128 frames is the network processing length, rather than the HR observation window in the main tables. This protocol ensures consistent accuracy evaluation across methods.
To evaluate online startup, when sufficient historical information has not yet accumulated, we further compare HR estimation errors at different observation lengths. KDPPG-S resets its states only at the beginning of the video and subsequently accumulates historical information, while RhythmMamba processes the first N frames observed so far. Both methods estimate HR from the predicted waveform and contact PPG of the corresponding length. HR is estimated using Butterworth bandpass filtering (0.75–2.5 Hz, forward–backward implementation) and Welch estimation, both restricted to the currently observed signal window without accessing future data.
KDPPG-S produces an accurate HR estimate from only 3 seconds of observed video, whereas the state-of-the-art method RhythmMamba cannot yet provide a meaningful HR estimate at this point. These results demonstrate that KDPPG-S reaches stable HR estimation with a shorter observation time.
| Observed frames | Observation time (s) | KDPPG-S MAE↓ | RhythmMamba MAE↓ |
|---|---|---|---|
| 60 | 2.00 | 7.96 | 11.35 |
| 70 | 2.33 | 5.41 | 7.42 |
| 80 | 2.67 | 4.48 | 13.28 |
| 90 | 3.00 | 3.40 | 11.50 |
Once enough video frames have been collected for all methods to produce stable and accurate HR estimates, we compare network throughput at different refresh strides during online inference. KDPPG-S uses a mathematically equivalent parallel implementation of multi-frame recurrence throughout the network, including PHRM. It therefore supports multi-frame input and rPPG output of the corresponding length: at a refresh stride of r frames, KDPPG-S processes only the r newly arrived frames, whereas clip-wise methods reprocess the latest 128 frames. For these throughput measurements, stride-1 inference retains recurrent states, while larger strides reset the states at the beginning of each chunk. All methods are evaluated on the same RTX 4090D GPU using FP32, a batch size of 1, and a spatial resolution of 128×128. We measure network inference time only, excluding initial observation, data transfer, and pre/postprocessing. Throughput is calculated as the number of newly arrived video frames divided by network inference time, in frames per second.
With matched output refresh intervals, KDPPG-S achieves the highest throughput. As the refresh stride increases, the student can process newly arrived frames together, reducing the overhead of per-frame calls. Its throughput advantage therefore extends from frame-wise updates to block execution at lower refresh frequencies.
| Method | Frames per call | Stride 1 | Stride 15 | Stride 30 | Stride 45 |
|---|---|---|---|---|---|
| KDPPG-S | Matches stride: 1 / 15 / 30 / 45 | 430.50 | 2832.09 | 3059.50 | 3127.40 |
| RhythmMamba | 128 | 49.10 | 736.66 | 1473.39 | 2275.80 |
| PhysNet | 128 | 54.82 | 825.13 | 1648.52 | 2501.63 |
| PhysFormer | 128 | 40.82 | 612.31 | 1224.42 | 1854.75 |
Thank you for the additional experiments. The comparison with KDPhys and the use of multiple teachers with the same student clarify the practical contribution. The controlled teacher ablation addresses my main concern: with the student held fixed, MAE decreases from 4.02 bpm without distillation to 3.75 bpm with a teacher that uses no auxiliary priors, and to 2.95 bpm with the prior-guided teacher. The prefix-only HR evaluation also provides more direct evidence for early HR estimation. One point should be made explicit in the revision: the startup accuracy experiment carries state across the video, whereas the throughput measurements at larger strides reset state between chunks. These results should be presented as measurements under distinct protocols. I am raising my score to 3 (Weak acceptance).
Thank you for recognizing our work and raising the score. We have clarified the different state-reset settings for the startup accuracy and throughput experiments in the captions of Tables 8 and 9 in the revised manuscript.
Response to Reviewer W2QH (Part 1/2)
We thank the reviewer for recognizing the value of teacher priors and periodic modeling, and for highlighting the need to distinguish the evidence for knowledge distillation from that for streaming deployment. We respond point by point below.
1. Contributions beyond KDPhys (W1 & Q1)
Beyond KDPhys, KDPPG provides a more general distillation framework and develops a state-of-the-art teacher and a reusable student. KDPhys relies on predefined teacher–student layer correspondences, limiting direct reuse across architectures. Adapting it to a new teacher or student requires reconfiguring the distillation locations and feature alignment when these correspondences no longer hold. Our framework supervises deep features and predicted waveforms without requiring layer-by-layer correspondence, allowing the student architecture to remain fixed when changing teachers. Appendix E.2 demonstrates this capability by using PhysNet, RhythmMamba, and KDPPG-T to supervise the same KDPPG-S student.
We will add the citation and discussion in the revised manuscript. We omitted it from the original comparison because we could not find publicly available official code. We have reimplemented KDPhys based on the details provided in its paper and compared both methods using the same MMPD data splits and HR evaluation protocol.
The three components contribute in distinct ways (All table and figure numbers refer to the revised manuscript.):
2. Contributions of distillation and teacher priors (W1 & Q2)
Distillation improves the student even with a prior-free teacher, while the prior-guided teacher provides further gains. To assess the contribution of prior-guided knowledge transfer, we compare the same student trained without distillation and with distillation from teachers sharing the same RGB backbone, with and without mask and PNCC priors. All student settings retain ground-truth supervision.
Our response continues in the next comment, where we address Question 3 on streaming evaluation, HR observation time, and efficiency at matched output refresh intervals.