- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a method, MATCHA. It learns per-channel temporal and cross-channel spatial summary tokens through a masked autoencoder whose reconstruction predictor sees summaries but not visible content tokens. Brain Treebank pretraining transfers to speech, memory, behavior, and interictal spike datasets.
Critical strengths
- The reconstruction bottleneck directly tests whether pretraining learns useful population summaries rather than leaving aggregation to downstream labels.
- Du-IN subject-level results and task-related neural analyses support the design.
Critical weaknesses
(1) The evaluation of speech decoding is potentially problematic. The authors state that they use subject-level normalization followed by random training, validation, and test splits. This raises a significant concern: the normalization process uses the test data, which causes data leakage. The proper way should be to split the data into training and test sets, and the normalization parameters should be estimated from the training set and applied to both the training and test sets. The original Du-IN dataset used channels selected according to their decoding contribution. This creates another potential source of inflated performance. (2) The contribution of the information bottleneck is not fully isolated. The proposed method combines several design choices: factorized spatiotemporal attention, dedicated spatial and temporal summary tokens, an information bottleneck, and downstream attention pooling. It remains unclear whether the improvement is primarily due to the proposed bottleneck principle or to the particular number, placement, and granularity of summary tokens. (3) The evidence of generalization across heterogeneous intracranial recordings is limited. It is well-known that intracranial recordings vary considerably due to electrode placement, anatomical coverage, recording hardware, referencing, and underlying pathology. The manuscript does not convincingly establish that the learned spatial summaries generalize robustly across these sources of heterogeneity, as the pretraining dataset, Brain Treebank (ten pediatric epilepsy patients), is too small and clinically specific. (4) The physiological interpretation of summary-token attention is limited. The authors visualize spatial and temporal attention patterns and report consistency with known speech-related regions and epileptiform activity. However, attention weights should not automatically be interpreted as the importance of specific neural populations or anatomical regions. It may just reflect correlated signals, electrode coverage, and statistical features associated with the task rather than independent physiological contributions.
Questions for authors
- Can the authors clarify whether repeated word trials from the same recording sessions appear in different partitions?
- Was channel selection performed independently of the test data, or were the ten channels per subject inherited from the original Du-IN study?
- Do the reported results represent within-subject, within-session decoding, or generalization across independent sessions? How would performance change under a session-disjoint evaluation protocol?
- Could the authors clarify whether the bottleneck and non-bottleneck models have identical encoder architectures, summary-token configurations, pretraining objectives, and computational budgets, differing only in the decoder's access to content tokens?
- How sensitive are the results to the number and granularity of spatial and temporal summary tokens?
- How robust are the learned representations when transferred to subjects with substantially different electrode configurations or anatomical coverage?
- How does performance change when anatomical location information is missing or when the downstream electrode coverage differs considerably from the pretraining distribution?
- Could the authors compare the proposed summary-token representations against simpler aggregation strategies, such as mean pooling, attention pooling over channel tokens, or a standard CLS-token representation, under matched model capacity and pretraining conditions?