- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a 380M parameter position-aware diffusion autoencoder, which utilizes large-scale heterogeneous EEG pre-training and multiple channel/time masking strategies to achieve channel completion, time interval completion, and spatial super-resolution. The author claims that the model can reconstruct EEG at any scalp position and in any number of channels.
Critical strengths
The paper is clearly organized and successfully builds a large-scale EEG reconstruction pre-training system. It also considers missing-data patterns that more closely reflect real-world scenarios compared to fixed random masks.
The zero-shot evaluation across different datasets and the dataset-level overlap checking are valuable engineering practices.
Critical weaknesses
The core contribution aligns more closely with large-scale system integration rather than a novel modeling mechanism. Diffusion autoencoders, RoPE, masked reconstruction, channel dropout, and large-scale pre-training all have mature precedents. The paper does not sufficiently articulate why this specific combination of components constitutes a novel general principle for EEG representation learning.
The claim of generalization to "arbitrary scalp locations" is overstated. The paper tests channel occlusion on unseen datasets or test samples, not on spatial coordinates that were entirely excluded during the training process. If standard 10-20/10-10 coordinates repeatedly appear in the pre-training corpus, the model is merely generalizing to new signals, not to novel physical locations.
Pre-training scale does not automatically equate to a universal interpolation capability. Unlike traditional interpolation techniques, ZUNA's output still depends heavily on preprocessing, coordinate normalization, reference schemes, and the distribution of the training corpus. The paper fails to demonstrate that a frozen model can stably replace spherical splines under conditions involving new hardware, novel montages, different reference schemes, and distributional shifts.
The provided details are insufficient to reproduce the core conclusions. Specifically, the training corpus, coordinate cleaning methods, channel mappings, mask generation, data leakage audits, and full evaluation codes are lacking. Furthermore, the description of how many dropout strategies were ultimately used needs to be unified between the main text and the supplementary materials.
Questions for authors
Please perform a rigorous coordinate-level permanent holdout: the held-out electrode locations must not appear in pre-training, fine-tuning, normalization statistics, model selection, or coordinate templates.
Can a completely frozen ZUNA stably outperform spherical splines on new montages, new reference schemes, and new devices that were entirely excluded from training? Please clearly separate the results for zero-shot, lightweight adaptation, and training from scratch.
Please release, or at least provide an auditable inventory of, the pre-training data, channel coordinate mappings, deduplication rules, mask generators, dataset holdout protocols, and model weight hashes.
Do the core conclusions of the paper still hold when compared against strong EEGSR and coordinate-queryable methods using the exact same input masks and evaluation protocols?
2 comments
Thank you for the clarifications. I acknowledge that the evaluations use frozen checkpoints, and appreciate the specific pointers to the supplementary materials. While, my main remaining concern is still existing: since you proposed a super-resolution method, but why didn't you give a quantitative report with EEG super-resolution method?
Questions for the Reviewer
We thank the reviewer for their feedback and comments.
We agree that we do not articulate our novelty well enough, particularly the large-scale diffusion model aspect. Of the 14 methods that NeuralBench tests, none are diffusion models. Of the diffusion EEG models that exist, which are relatively few (none with open-source code), none exist at the training corpus size or parameter count of ZUNA.
On that note, concerning "Please release, or at least provide an auditable inventory of..." that we have already done parts this where possible, and where we haven't that the request is either unreasonable or simply ignores the materials already provided. In Appendix H, we release a list of IDs in our dataset audit, where we also explained our choice of holdout datasets being conditioned on our training corpus to prevent leakage. We do not have rights to release this data (even open-source datasets like TUH have distributional limits), and even if we did, our training dataset is 10s of TBs. Our code includes mechanisms to evaluate the model on an MNE dataset. Also, the model weight hash is already included in our ZUNA supplementary code. Section 3.4, Table 1 specifies all eight strategies, their probabilities, and the three-stage training curriculum. The mask generators are implemented in the supplementary eeg_data.py, beginning with perform_token_dropout().
On the note of "arbitrary scalp locations," there may be a significant semantic disagreement. Our use refers to the model's ability to accept user-specified electrode coordinates within its supported spatial discretization, rather than requiring a fixed output montage like the neural methods examined in the paper. Unlike architectures with learned embeddings tied to specific electrode identities, ZUNA conditions directly on spatial coordinates. Consequently, it can reconstruct channels at positions not measured in the input recording without architectural modification. Of course that will depend on the training data: the hope is that our cumulative coverage is enough to fill in the gaps, which we have shown in our main experiments. All of our experiments are done with frozen checkpoints, and Figure 4 already demonstrates that our model beats spherical-spline on novel montages. Specifically, in the case of high dropout regimes (particularly <75-90% missing channels) we have demonstrated generalization to an incredibly sparse montage that spherical-spline cannot recover.
We do not claim that our evaluations establish uniformly strong performance at coordinates permanently excluded from the entire pretraining corpus, and would be happy to soften the language here. But the criticism addresses a stronger question than the demonstrated ability to reconstruct missing channels across held-out datasets and heterogeneous montages: that is, combinations of frequently used montages. If this concern is strongly held enough by the reviewer, we will oblige with their request. However, at the moment, "Please perform a rigorous coordinate-level permanent holdout: the held-out electrode locations must not appear in pre-training, fine-tuning, normalization statistics, model selection, or coordinate templates." is not well-specified enough to run an experiment that would satisfy what the reviewer appears to want. In particular, it is unclear what constitutes a held-out coordinate: an exact 3D position, a discretized spatial bin, or an entire neighborhood within some specified distance of an electrode. This distinction is consequential because nearby but nonidentical electrode positions occur across montages, and ZUNA models spatial coordinates rather than discrete electrode identities. And RoPE works on relative distances between coordinates, not the coordinates themselves. The prohibition on using held-out coordinates in "coordinate templates" is ambiguous: a common coordinate and reference system is necessary to define electrode positions, and using that reference system does not itself constitute exposure to held-out EEG signals during training.
"ZUNA's output still depends heavily on preprocessing, coordinate normalization..." both is and is not a fair criticism. It is trivially correct that the model is dependent on the distribution of the training corpus. Indeed, the same thing could be said for almost any model. The cost of zero-shot spline interpolation is that, as we show in Figures 1, 3, and 4 that increasing the distance between missing electrodes results in heavy error for these sorts of methods. As for preprocessing, as examined in the paper, we trained on multiple variants to loosen preprocessing requirements which is rare in FM literature. Indeed, this is done for users who want to interpolate heavily bandpass-filtered data, and our least restrictive requirement (ie normalization) seems unfair to qualify as "heavy."