- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper is set in the context of seizure forecasting, which is basically modelled as a binary classification between preictal (roughly the 30 min period prior to a seizure) and interictal EEG segments. In this context, the paper studies the adaptation of pre-trained models to a new patient using only preictal samples preceding an initial recorded seizure, but no background (interictal) samples. The ChronoProto method proposed in the paper basically starts from a prototypical network approach pre-trained on source data. To then adapt it to the target data using only positive (preictal) samples, the prototype for the positive class is recomputed from the target samples using the frozen encoder trained on source data. The results show no significant improvement in performance compared to source-only baselines. The authors further conclude that the reference (i.e. the prototype of the negative/interictal class) affects performance.
Critical strengths
None
Critical weaknesses
- The paper provides neither a methodological contribution nor any practicable application-specific value. The proposed ChronoProto method uses an existing approach (prototypical networks) and demonstrates no improvement over source-only baselines. The problem setting of assuming access to only preictal but no interictal data appears artificial and without any practical relevance.
- The conclusion that the reference (prototype for the negative/interictal segments) matters is hardly surprising. The prototypes are the key constituents of prototypical networks, the distance to which directly determines the classification.
- The paper is hard to follow, not well motivated, and lacks methodological details (see questions for details).
Questions for authors
- Can you motivate the studied problem? Why should we care about calibration using only preictal but not interictal data? Isn't it extremely unlikely that one would have access to only preictal data in practice?
- Can you clearly delineate in the methods section (ChronoProto) where you are simply following prior work (e.g. prototypical networks), and what (if anything) is new? Prototypical networks are acknowledged in related works, but the methods section could be improved by making these distinctions clear.
Lacking methodological details. For instance, section 3.2 introduces the source-defined representation space.
- L169: what is meant by "positive locations"? Positive (i.e. preictal) samples?
- L171/172: "m_s is the balanced source mean": balanced by what?
- L173: "D_s is a diagonal matrix of scale factors computed from source data": computed how and what for?
- L181: "balanced variance": balanced by what?
Further suggestions:
- The word "release" is used several times in a confusing way: e.g. L015 (a protocol that releases an episode), L153 (chronological release of episode).
- I had to read large parts of the paper just to understand the problem setting (as I summarised it above). A few introductory sentences to explain how seizure prediction is framed as binary prediction between interictal and preictal segments, what you consider the positive and negative class, etc. would improve readability. Terminology from related few shot literature (e.g. episode, support) could also be briefly introduced before it is used.