- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper compares two EEG microstate discovery pipelines: CNN-VaDE, which interpolates 61-channel scalp potential topographies into 40×40 images, and Graph-VaDE, which performs convolutions directly on the electrode layout. Experiments were conducted on 203 closed-eye resting-state EEG recordings from the LEMON dataset, using consistent input preprocessing and GFP-peak selection. The two methods were evaluated via subject-matched analyses—comparing spatial maps, Global Explained Variance (GEV), mean duration, occurrence, and transition/complexity statistics—with a modified K-means algorithm included as a benchmark.
Critical strengths
-
For the same participants and identical inputs, two native pipelines exhibit an approximately twofold difference in "dwell" duration; however, this discrepancy largely disappears following a unified decoding process. This finding has direct implications for cross-method comparisons and holds greater scientific value than the mere pursuit of higher clustering scores.
-
Based on 203 paired subjects, we examined the GEV for . Our primary analysis employed the Wilcoxon test, Holm correction, and bootstrap confidence intervals, while also incorporating a modified K-means approach. For , the mean GEV is 0.625, slightly higher than the 0.618 obtained via the graphical model.
Critical weaknesses
-
The core causal claim—that "geometry determines mapping and transfer"—is confounded. Beyond differences in input geometry, graph-based models and CNNs also diverge in terms of latent variable dimensionality and loss function components. While a unified decoding framework mitigates temporal-statistical confounds, it fails to isolate whether topological differences stem from input representation, model capacity, optimization, or the loss function. Consequently, attributing the observed results to "spatial encoding" remains insufficiently supported.
-
Limited validation regarding extrapolation and independence. The study relies on a single dataset, a single state condition, and a single montage. Furthermore, because each model is trained on the GFP peaks of the very recordings used for subsequent reconstruction, the reported GEV (Global Explained Variance) reflects in-sample fitting rather than generalization to an independent test set. The authors also acknowledge that the same cohort of 10 participants was used for training-seed selection, peak-level random partitioning, and model architecture search. Therefore, the finding that "graph-based methods yield higher GEV" does not necessarily imply greater reliability on new, unseen recordings; the study lacks assessments of seed stability and test–retest reliability.
Questions for authors
-
Under identical conditions—including latent variable dimensionality, loss weights, parameter budget, and optimization settings—do the findings regarding GEV, map correspondence, and transition matrices (derived via a unified decoding approach) still hold when varying the 2D interpolation method or the electrode-map representation?
-
When the training/test split is based on individual subjects—evaluating the model on recordings not used during the fitting process—do the observed advantages in GEV and map stability persist? Could you provide results across multiple random seeds and test–retest intervals?
-
How can the reported advantages in transition statistics coexist with the observation that dwell times and occurrence rates are essentially aligned? Please include sensitivity analyses regarding the smoothing kernel, minimum segment duration, microstate matching/permutation procedures, and the selection of .