- Rating
- 4(+2)
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper analyzes the problem from the perspective of feature-space mismatch: while a physiological structure may be present in the raw EEG data, it is not necessarily easily decodable from pre-trained representations—especially given constraints such as limited model capacity, scarce annotations, and the specific readout mechanisms employed. The authors propose operator preconditioning, which involves using deterministic physiological signal operators to construct an input space tailored to the target structures, followed by pre-training an encoder within this space. The resulting framework, dubbed OpView, incorporates five independently trained "views"—Waveform, Frequency, Relation, Projective, and Dynamics—each with its own specific objective. Theoretically, the paper employs the conditional expectation of the squared loss to characterize the "reward" that a prediction target provides regarding the underlying physiological structures. The approach is evaluated across nine datasets and various cross-subject and intra-subject scenarios, with comparisons drawn against several baselines, including fixed operators, randomly initialized encoders, standard pre-trained encoders, and 12 EEG foundation models featured in the EEG-FM-Compass benchmark.
Critical strengths
-
Clearly disentangles "information inherent to the operator," "inductive biases of the architecture," and "learning gains derived from pre-training." By fixing the coefficient of determination () for the power operator at approximately 0.99—compared to ~0.63/0.61 for patch embeddings and ~0.93/0.90 for pre-trained encoders—the study provides empirical grounding for its arguments regarding feature space mismatches.
-
Demonstrates an awareness of structural adaptation across physiological tasks, while transparently reporting instances of failure. The framework employs distinct views to capture temporal transients, spectral power, inter-channel relationships, and polarity-invariant topology and dynamics. Notably, for the P300 task, a view that discards sign information performs no better than random chance, illustrating that no single architectural view is a "universal solution" (pp. 6–8). The appendix further clarifies key procedural details, such as the presence of evaluation data within the unsupervised pre-training set and the use of transductive alignment protocols.
Critical weaknesses
-
The reported performance, which claims to be "better than the best foundation model," relies on post-hoc selection of individual views; it does not yet constitute a label-free selection strategy suitable for direct deployment. In Table 2, the "View" column reflects the selection of the optimal pre-trained view for each specific dataset/setting—an optimal view that varies across different tasks. While the "Fusion" approach avoids the use of test labels, it combines features from operators, random encoders, and pre-trained models, and employs a ridge regression or ensemble readout mechanism that differs from those used with the published foundation models.
-
The benchmarking comparisons suffer from significant incompleteness and issues regarding resource comparability. Appendix Table 14 (page 28) acknowledges that some entries are based on only a single classifier seed, some cover only the first seven held-out subjects, and the window counts for the CHB-MIT dataset are inconsistent with the established benchmarks. Furthermore, the unsupervised pre-training phase incorporates data from a subset of subjects across the seven evaluation datasets; the total amount of data exposed to each model during pre-training—and the overall fairness of these comparisons—requires standardized reporting. Additionally, the cumulative computational cost of the five independent encoders and the fused readout mechanism should be compared against that of a single foundation model.
Questions for authors
-
If a fixed set of view selection and readout rules is determined using only the validation set—prohibiting the selection of the "best" view based on the test set—what would the overall win/tie/loss statistics be across the 9 datasets when compared against the 12 publicly available baseline models? Please provide a comparison following the same protocol as the main table.
-
Please address the missing subject-fold entries and classifier random seeds noted in Table 14, as well as the window alignment for the CHB-MIT dataset; then, report how these revisions affect the core conclusions.
-
What are the differences in performance and computational cost for the
Fusionapproach when using only pretrained views, pretrained views plus operators, and the full configuration (including random encoders)? This will help determine whether the performance gains stem from representation learning or from the engineering of the readout mechanism.
9 comments
Response to Reviewer i42G (2/2)
Response to Reviewer i42G (2/2)
W2 and Q2. Complete 3-seed subject-fold coverage and CHB-MIT window alignment (Appendix E, Appendix G)
- Motivation: To eliminate any partial-fold or seed-sampling variance and resolve the window-count discrepancy on CHB-MIT, we completed all 131 held-out subject folds across all 9 datasets with 3 classifier seeds and audited the benchmark's public CHB-MIT data generator.
- Result:
- Complete folds and seeds: Every frozen evaluation table in the revised paper covers 100% of subjects across all datasets with 3 random seeds.
- Root cause of the CHB-MIT window discrepancy: In 20 lines of the upstream PhysioNet CHB-MIT summary files, the colon is followed by two or three spaces instead of one. The benchmark's public regex parser skips those 20 lines and mis-pairs subsequent start/end timestamps, dropping 23 true seizures and mislabeling 831 interictal windows as seizure. Fixing only this whitespace regex yields 29,841 windows (matching the benchmark's intended 29,840 count), and we evaluate OpView and every published baseline on the exact same corrected dataset. (The 75.2% score reported for CBraMod in the benchmark paper comes from a tuned head on the mis-parsed labels; under the shared ridge probe on the corrected labels CBraMod scores 67.5%, with the difference driven primarily by decision thresholding under class imbalance; Appendix G.)
- Significance for our core conclusions: Completing all folds, seeds, and CHB-MIT windows confirms and sharpens all three conclusions: (1) operator-defined feature spaces expose task-relevant structure and distinct views are complementary; (2) under a single validation-calibrated rule (R-cal) and shared probe without test-label selection, OpView matches the post-hoc best baseline on 7 of 9 datasets, beats it on 1 (CHB-MIT), and trails on 1 (SEED); and (3) frozen pretraining adds +1.0 point unaligned and +1.3 aligned over random initialization across the 9 datasets (and +8.3 to +13.8 points on large-scale TUAB and Sleep-EDFx; see our Nov. 15 update), whereas end-to-end supervised fine-tuning adapts random and pretrained initializations comparably within the operator space (Table 23).
W2. Standardized zero-exposure pretraining corpus and cross-model exposure audit (Appendix D.1, Appendix J, Table 34)
- Motivation: To ensure strictly leak-free evaluation and transparent comparison against published models whose pretraining corpora overlap with downstream benchmarks, we standardized all OpView checkpoints on a zero-exposure corpus and documented corpus exposure across all baselines.
- Result & Significance: Every OpView result in the revised paper uses standardized 30,000-step checkpoints trained on 61 public sources (2,321 hours) that exclude all 13 benchmark datasets entirely (Appendix D.1,
PROVENANCE.md). In addition, Table 34 documents pretraining data, compute budgets, and benchmark exposure for all compared models: notably, SEED is included in the pretraining corpora of EEGPT and LaBraM, and BCI IV-2a and 2b are included in ST-EEGFormer. Even with zero exposure to those datasets, OpView is statistically higher than EEGPT on SEED (+7.3 points, ) and ST-EEGFormer on BCI IV-2b (+10.8 points, ), and statistically indistinguishable from LaBraM on SEED (+1.9) and ST-EEGFormer on BCI IV-2a (+1.1).
W2. Total five-branch computational cost vs. single foundation models (Table 33)
- Motivation: Because OpView comprises five independent branches that share no parameters, its deployment and pretraining cost must be evaluated as the sum of all five branches against single-backbone foundation models.
- Result & Significance: Summing across all five branches, OpView totals 19.3M parameters, 33.5 GFLOPs, and 16.6 ms latency per 22-channel, 4 s window (on one RTX 5060 Ti, batch size 32), plus ~2 ms on CPU for the five ridge probes and R-cal fusion. Total pretraining across all five branches requires 24–27 A100-equivalent GPU-hours (about total FLOPs)—4 to 8 times fewer GPU-hours than reported for single foundation models such as CodeBrain, CBraMod, and LUNA (Table 33).
We thank the reviewer again and would be glad to clarify any remaining points.
Update for Reviewer i42G: completed comparisons
Update for Reviewer i42G: completed comparisons
TL;DR: We report three completed sets of experiments addressing Q1, Q2/W2, and Q3: (1) direct evaluation of our five parameter-free operators alone against all 12 published encoders under the shared ridge probe, showing that the operators alone beat 10 of 12 published encoders when pooled (Q3, Table 28); (2) side-by-side unaligned and per-subject aligned pretraining gains (Q3, Table 1: +1.3 over random initialization and +2.2 over operators under alignment, with Dynamics, Waveform, and Projective all gaining significantly) plus initial equal-weight results on three extension datasets (Q1, Appendix K); and (3) complete 3-seed fine-tuning across all 9 datasets (Q2/W2, Table 23) and anonymous weight release.
Thank you again for your review. We have uploaded a revised manuscript and supplementary package with improved readability (Section 5), completed experimental runs, and anonymous pretrained weights on Hugging Face (https://huggingface.co/Anony-0x3f/opview-v2-30k). All table, section, and appendix numbers match our first reply. Below we summarize the new results most relevant to your questions.
1. Q3: Disentangling representation learning from feature-space priors and readout (Table 28, new columns; Table 1)
- Motivation: To test directly how much of OpView's advantage over published foundation models comes from the operator-defined feature spaces versus pretraining—under the exact same ridge readout for every model—we added a head-to-head comparison of the five parameter-free operators alone against each published encoder (Table 28) and placed unaligned and aligned pretraining decompositions side by side (Table 1).
- Result & Significance:
- Operators alone vs. published encoders (Table 28): Combined by the same rule and read by the same ridge probe without any pretraining, the five parameter-free operators are statistically higher than 10 of the 12 published encoders when pooled across the 9 datasets, and not statistically different from EEGPT and ST-EEGFormer. Most of the gap over existing encoders is therefore already established by the operator-defined coordinate spaces under a unified linear probe.
- Pretraining contribution without and with alignment (Table 1): Alongside the unaligned gains (+1.0 over random initialization, +2.6 over operators), per-subject alignment yields +1.3 points over random initialization () and +2.2 points over the operators alone (), with three views gaining statistically (Dynamics +7.8, Waveform +4.5, and Projective +4.4).
2. Q1: Extending evaluation beyond the 9 BCI datasets (Appendix K, Tables 36–37)
- Motivation & Result: To test generality on larger clinical, vigilance, and visual-retrieval benchmarks, we applied the same five pretrained views and ridge probe to three additional EEG-FM-Compass datasets. Under an initial uncalibrated equal-weight control (with validation-calibrated R-cal and Sleep-EDFx completed in our Nov. 15 update):
- TUAB (clinical abnormality): OpView reaches 81.0%, statistically higher than 11 of the 12 published encoders and matching EEGPT (80.5%), even though 7 of the 12 baselines include TUAB in their pretraining corpus while OpView has zero exposure.
- SEED-VIG (vigilance regression): Prediction error is statistically lower than 8 published encoders and not different from the other 4.
- Things-EEG2 (visual retrieval): Under equal weights—where two non-visual views (Frequency, Relation) are at chance and weighted equally with the others—OpView beats 5 encoders, ties 1, and trails 6 (54.5% vs. 60.1% for ST-EEGFormer; as shown in our Nov. 15 update, applying our standard validation-calibrated R-cal rule raises Things-EEG2 by +3.6 points to 58.1%/58.3%, beating 12 of 13 encoders).
3. Q2 and W2: Complete 9-dataset 3-seed fine-tuning and cost discussion (Tables 2 and 23, Section 6)
- Motivation, Result & Significance: Completing 3-seed end-to-end fine-tuning of the Dynamics encoder across all 9 datasets (adding BNCI2014008, SEED, and CHB-MIT; Table 23) shows that pretrained and randomly initialized encoders do not differ statistically on any dataset without alignment (−1.8 to +0.9 points), while with alignment pretrained initialization is higher on BNCI2015001 (+1.7, ) and lower on BNCI2014009 (−1.1 AUROC, ) and CHB-MIT (−4.3, ). This confirms that full supervised optimization adapts weights effectively inside the operator space from scratch, whereas self-supervised pretraining specifically benefits frozen transfer to unseen subjects (Section 5.3). Section 6 also explicitly notes the five-branch inference cost alongside Table 33.
We would be glad to clarify any remaining points.
Response to Reviewer i42G (1/2)
Response to Reviewer i42G (1/2)
TL;DR: Across Parts 1 and 2, we replace post-hoc per-view reporting with a single deployment-ready model combining only the five pretrained views via one validation-calibrated rule (R-cal, fitted strictly on training subjects without test labels) under a shared ridge probe across all models (W1, Q1), isolate parameter-free operators and random encoders as standalone control models (Q3), and complete all 131 held-out subject folds across 3 seeds with corrected CHB-MIT seizure parsing (29,841 windows), a unified zero-exposure pretraining corpus (61 sources, 2,321 h), and full computational cost comparisons (W2, Q2).
We sincerely thank the reviewer for the detailed and constructive review, which has helped us make our evaluation fully unified and deployment-ready. Below we address W1, Q1, and Q3, followed by W2 and Q2 in Part 2.
W1 and Q1. Deployment-ready validation-calibrated fusion (R-cal) and win/tie/loss statistics (Section 5.5, Tables 2, 26–28)
While the initial View column in Table 2 was included alongside Fusion to illustrate which physiological view aligns with each paradigm, we agree that main benchmark comparisons should evaluate a single, label-free deployment model under an identical readout protocol across all baselines:
Under this unified protocol, OpView is statistically higher than almost all published encoders (Table 28; ‡ indicates baseline pretraining exposure to evaluation datasets):
Against 11 of the 12 encoders, OpView is higher on 5 to 9 datasets and lower on none; ST-EEGFormer is the one encoder at our level. Even against the post-hoc best baseline on each individual dataset (a choice made on test scores), our fixed model is statistically indistinguishable on 7 datasets, higher on CHB-MIT, and lower on SEED (Table 2; with per-subject alignment on both sides, OpView is higher on BCI IV-2b and indistinguishable on the other 8). For reference only, Table 26 reads OpView with the benchmark's unregularized linear head on the raw concatenation of all five views (leading on EEGMat, 77.4 vs. 68.6, and Nakanishi2015, 86.2 vs. 85.5, but trailing where the informative view holds only a few percent of total variance, such as Dynamics at 2–5% on motor imagery—showing why per-view normalization and calibration in R-cal are essential).
Q3. Isolating pretrained views from operators and random encoders (Appendix F, Table 18)
To determine whether OpView's gains stem from representation learning or from mixing operators and random networks in the readout, our main model contains only the five pretrained views, while operators and randomly initialized encoders form standalone control models built by the same rule: