- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors introduce MOSAIC, a differentiable medical time-series classifier that uses a relaxation of phase-amplitude coupling (PAC) features as the input. This is implemented through a Gaussian filterbank with learnable parameters and , which contrasts the fixed bands usually used in PAC analysis. The PAC features are joined with a parallel waveform branch to use as input tokens for a transformer used for classification. The loss function includes a classification loss, an orthogonality penalty to ensure PAC tokens encode distinct information, and a smoothness penalty that works under the assumption that amplitude changes smoothly as phase moves. Results show strong performance, outperforming transformer baselines and fixed-feature PAC classifiers in accuracy, precision, recall, and F1 score on two EEG datasets and one ECG dataset.
Critical strengths
-
Grounded and Well-Motivated Method: The paper merges a well-known EEG biomarker in PAC with a differentiable deep learning and data-driven framework, introducing adaptable frequency bands to classify and interpret time-series medical data. The authors also include proper ablations against different PAC estimation methods.
-
Strong Results Outperforming Baselines: The authors present results that significantly outperformed transformer models and fixed PAC classifiers in three time-series datasets.
Critical weaknesses
-
Architecture Justification: The main novelty presented in this paper is the differentiable relaxation of PAC features. However, the deep model architecture decisions are unfounded and unclear. The authors use a transformer on PAC features for classification. Given that only 12 total PAC tokens are passed through the model, the architectural complexity is surprising. Ablation against a simple MLP is necessary to justify it.
-
Interpretability Claims: While I do understand that aggregate reliance helps with interpretability, no empirical evidence of this is present to back up the authors’ claims. I would like to see the final and aggregate reliance values on at least one dataset. Additionally, adding the waveform stream as input is a large structural change that further blurs the interpretability claims. The classifier can heavily rely on the raw waveform stream, which reduces the necessity of the PAC tokens. This is evident on the results in table 4, with performance becoming comparable to the baselines without the waveform stream.
-
Generalization to Medical Time-Series Data: PAC features are popular with EEG data, but the authors claim that MOSAIC can be used on all medical time-series data. These claims should be narrowed down, or substantive evidence of PAC features being used on different medical time-series data such as ECG is necessary. Given that raw waveform streams are part of the input data and there is limited literature on PAC in ECG, a single dataset of empirical evidence is not sufficient.
Questions for authors
-
Can you provide any results showing evidence of the interpretability claims made in section 3, given that it serves as the primary motivation for the orthogonality penalty and the use of self-attention?
-
Can you provide ablations on the orthogonality and smoothness terms in the loss function? While properly justified in text, no insight regarding their impact on performance is shown.
-
The adaptable possibly removes clinical utility of the learned PAC features if they significantly diverge from any understood frequency bands. Is there any way to constrain based on prior information, or is this purely done based on the initialization?
-
I have strong concerns regarding the addition of the waveform stream to the input tokens, as it diminishes the utility of the PAC tokens. Can you provide evidence and justification on the advantages of using joint PAC and waveform stream tokens as opposed to just the latter, either for interpretability or performance?