- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
PLARE uses a patch-level mixture of experts to process fixed-length 12-lead ECG patches according to their waveform content. Content-dependent routing selects experts based on each patch's convolutional features. Retained expert outputs replace the original features before token projection and a temporal Transformer, with the originals kept if capacity filtering removes all of a patch's assignments. Pretraining combines masked reconstruction, same-patient contrastive learning, and routing regularization. The authors evaluate linear probing and fine-tuning on four PTB-XL label sets and CPSC2018. PLARE has higher AUROC and AUPRC than the compared baselines on four of five tasks under both protocols. INCART is used to examine expert allocation.
Critical strengths
- Patch-level experts are well motivated by ECG morphology variation. Placing conditional feature transformations between convolutional feature extraction and the temporal Transformer gives the experts and temporal model complementary local and cross-patch roles.
- The ten baselines share the same unlabeled pretraining pool, with downstream procedures aligned where architectures permit. PLARE achieves higher AUROC and AUPRC than the compared baselines on Sub, Rhythm, Form, and CPSC under both linear probing and fine-tuning, providing convincing evidence of overall effectiveness.
- The replacement and routing ablations generally favor the proposed choices. INCART permutation tests also show different router-selection distributions for normal-beat and premature ventricular contraction contexts, supporting an association between signal content and expert allocation.
Critical weaknesses
- The residual control sums original features and expert outputs with unit weights, keeping the expert and router architectures unchanged. Replacement gives a higher mean C (the average of AUROC and AUPRC) on four of five tasks under each protocol. Without adjustable weights or gated fusion, this does not establish whether discarding the original features is preferable to a flexible combination.
- In w/o CDR, each patch position uses one fixed expert across all ECGs. The comparison therefore combines content-dependent selection with removal of a positional constraint, limiting attribution of the routing gains. All-expert aggregation provides another control, but also changes the number of experts used per patch.
Questions for authors
- Figure 5 analyzes routing before capacity filtering. Do the differences between normal-beat and premature ventricular contraction contexts persist in the retained expert assignments actually used for patch feature replacement?
- How would the model perform if all patches used one shared expert of the same architecture? This would approximately match the cost of a single feature transformation, complementing all-expert aggregation, which already matches total expert parameters but uses more computation per patch.
- Why do contextual experts within the temporal Transformer fail to improve results consistently? Could existing training or routing statistics clarify how their use differs from that of patch-level experts?
2 comments
I thank the authors for their thoughtful and transparent response. While the rebuttal clarifies several experimental details, key controls, including flexible feature fusion and a shared-expert baseline, are still missing. The contributions of the core design choices therefore remain insufficiently isolated. I maintain my original score.
Scope of the Component Comparisons and Routing Analysis
Thank you for recognizing the complementary local and temporal roles and the overall transfer results. We address the two weaknesses and three questions below.
W1. Replacement versus flexible fusion. We agree that the reported result establishes a comparison with unit-weight residual addition, not with a flexible combination. PLARE and PLARE-Residual share the expert/router architectures, temporal Transformer, projection, preprocessing, and reconstruction/contrastive objectives; each variant has its own pretrained checkpoint (§4.2; D.1, Eq. 19). Replacement has higher mean C on four of five tasks under each protocol (Tables 3–4).
Learned scaling and gated fusion are not reported. We cannot conclude from the unit-residual comparison that discarding the original features is preferable to a learned combination.
W2. Fixed-position assignment. We agree that the fixed-assignment comparison changes both content dependence and the positional constraint. The mapping is approximately balanced and reused across recordings and epochs independently of waveform content (§4.2; D.1). CDR has higher mean C in all ten task–protocol comparisons using the same four-expert architectures and count, but the contributions of the two changes are not separated.
All-expert averaging retains the expert bank while increasing active computation; it also retains straight-through router learning and auxiliary losses (A.3; D.2). Each selection setting is pretrained separately. We agree that this is a complementary control rather than an isolation of content-dependent selection at matched active computation.
Q1. Retained expert assignments. Section 5.4 reports pre-capacity N/PVC selection–context association. Appendix G reports 16.056% rejected selections in the finite-capacity INCART analysis. With Top-1 selection, rejected patches retain their original features; tokens are not removed. The rate is not an estimate for downstream PTB-XL or CPSC.
We do not have a reported post-capacity analysis establishing whether the N/PVC difference persists in the retained assignments. The aggregate rejection rate cannot answer this. We acknowledge that the current analysis does not establish the corresponding association for executed expert transformations.
Q2. One shared expert. The submission does not report this model, so we cannot provide its performance. We agree that one shared expert would approximately match the active cost of one expert transformation while using fewer total expert parameters, complementing all-expert averaging. The current comparisons do not resolve whether the expert bank improves on that shared transformation.
Q3. Contextual experts. Section 5.5 and Appendix E (pp. 9, 24–25) report higher mean C for PLARE than PLARE-Joint on three of five tasks under LP and four under FT. Joint is higher on Super and Form under LP and CPSC under FT. This describes a lack of consistent improvement from the evaluated Top-1 contextual extension.
The submission does not provide module-level routing or training-statistic analyses that explain this pattern. We therefore cannot determine why contextual experts did not consistently improve performance. The reported comparison establishes the performance pattern, not its cause.