- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes TopoJEPA, a two-stage self-supervised framework for learning transferable EEG representations through topology-grounded latent prediction. In the first stage, Topological Target Grounding (TTG) maps heterogeneous EEG electrode configurations into a fixed set of hemisphere- and region-level tokens and learns their representations through waveform and spectral reconstruction. A separate reconstruction-specific branch is introduced to accommodate information that may be useful for signal recovery but less relevant to transferable representations. In the second stage, Topology-Grounded Autoregressive Prediction (TGAP) freezes the grounded target pathway and trains a context encoder to predict future topology representations under structured spatiotemporal attention and masking constraints. The method is evaluated on ten datasets covering six EEG decoding task families, using both full fine-tuning and linear probing. The reported results demonstrate competitive downstream performance and particularly strong linear-probing results. Additional experiments investigate target-space grounding, the reconstruction-specific branch, and spatiotemporal attention constraints.
Critical strengths
- A meaningful attempt to integrate structured spatial representations with latent predictive learning for EEG. The combination of topology-constrained tokenization, hierarchical hemisphere/region representations, and autoregressive latent prediction provides a coherent framework for handling heterogeneous EEG montages. The reconstruction-specific branch is also a reasonable architectural choice for reducing the influence of low-level reconstruction requirements on the prediction targets. These components address relevant challenges in EEG foundation model development.
- Broad empirical evaluation and informative component analyses. The evaluation covers ten datasets from six task families, including emotion recognition, motor imagery, cognitive workload, task difficulty, vigilance, and clinical EEG classification. The strong linear-probing performance on several benchmarks is encouraging. The analyses of grounding configurations, auxiliary representations, attention constraints, and masking strategies provide useful evidence that these design choices influence downstream representation quality.
Critical weaknesses
- The main methodological claim is not sufficiently isolated from training-budget and architectural confounders.
The central idea of establishing a fixed reconstruction-trained target encoder before predictive learning is closely related to SALT, which the authors acknowledge. Therefore, the primary methodological novelty should be demonstrated through the EEG-specific topology grounding and reconstruction-specific representation design, rather than the two-stage training principle alone.
More importantly, the experiments do not conclusively isolate the benefit of fixed target-space grounding from differences in training procedures and computational budgets. In Appendix E.1, the EMA-JEPA reference is trained for 80 epochs, whereas TopoJEPA involves 80 epochs of TTG followed by another 80 epochs of TGAP. The comparison also differs in target construction and training configurations. Consequently, the improvement over EMA-JEPA cannot be attributed specifically to freezing a topology-grounded target space.
A more decisive evaluation would compare fixed and EMA-updated targets using the same grounded initialization, architecture, objective, training data, and matched computational budgets. Without these controls, the principal mechanism underlying the reported improvement remains insufficiently established.
- The necessity and specific contribution of the proposed topology structure remain incompletely demonstrated.
The paper emphasizes hierarchical topology as a central factor in learning transferable EEG representations. However, some ablation results provide mixed evidence for this claim. In Figure 3 and Table 15, the full-channel encoding variant achieves slightly higher linear-probing Balanced Accuracy than TopoJEPA (37.63% versus 37.29%). In Table 2, removing the hemisphere-to-region attention constraint also slightly improves linear-probing Balanced Accuracy (37.68% versus 37.29%). Although the proposed model performs better under full fine-tuning in these comparisons and offers computational advantages over electrode-level tokenization, the results do not establish that the chosen anatomical hierarchy is intrinsically more effective for learning transferable representations.
The evaluation would also benefit from a stronger distinction between topology-specific inductive bias and the general benefits of token compression, masking, and representation capacity. Comparisons against alternative or randomly constructed spatial groupings under matched token counts and model capacity are needed. In addition, the claimed generality across heterogeneous montages would be more convincing with explicit cross-montage transfer and robustness experiments, rather than downstream performance comparisons alone.
Questions for authors
Q1. Can the authors provide a computationally matched comparison between fixed-target and EMA-target JEPA? Specifically, how does TopoJEPA compare against an EMA-JEPA trained with an equivalent total computational budget? More importantly, what happens when both approaches start from the same TTG-pretrained target encoder and differ only in whether the target encoder remains frozen or is updated by EMA? This would directly test the central claim of Grounding Before Prediction.
Q2. How much of the improvement is attributable to anatomical topology rather than token compression or hierarchical attention? Could the authors compare the proposed nine topology tokens with random electrode groupings, alternative region partitions, or geometry-based learned groupings under matched representation dimensions and computational budgets? The higher linear-probing scores of certain topology-relaxed variants make this an important question for understanding the claimed mechanism.
Q3. Could the authors clarify the implementation of the spatiotemporal attention mask in Equation (5)? According to Equation (5), hemisphere tokens at the first time step appear to have no valid attention keys, since neither the historical cross-role condition nor the within-step hierarchical condition can be satisfied. This seems to produce fully masked attention rows, which may lead to numerical instability under a standard masked-softmax implementation. Could the authors clarify how these cases are handled in practice, for example, whether self-attention entries are explicitly preserved or a special treatment is applied to fully masked rows? It would also be helpful to clarify whether the implemented attention mask exactly follows Equation (5).
7 comments
W1 & Q1. Methodological Contribution and Controlled Evaluation of Grounding
We thank the reviewer for the careful assessment of our methodological contribution and experimental design. We would like to emphasize that the central methodological question of TopoJEPA is how to construct and exploit effective prediction targets for EEG foundation models. Given the low signal-to-noise ratio, non-stationarity, and complex spatiotemporal dependencies of EEG, we propose Grounding Before Prediction to establish a structured and stable latent target space before predictive learning. We further develop an interconnected two-stage framework, where topology-aware grounding and reconstruction-specific auxiliary routing shape the target representations, while spatiotemporal attention constraints guide subsequent predictive learning. This design provides a unified approach to learning transferable EEG representations.
Regarding the EMA comparison, our original experiment was intended to compare two distinct predictive learning paradigms rather than serve as a strict ablation of target freezing. In preliminary experiments, combining EMA-updated targets with our spatiotemporal constraints frequently led to training instability. We therefore adopted established I-JEPA/V-JEPA optimization practices for the EMA baseline rather than directly imposing TopoJEPA's complete configuration.
To directly address the reviewer's concerns about initialization, architecture, optimization, and computational budget, we introduce four controlled configurations to distinguish TTG initialization, target updating, and spatiotemporal predictive learning, as summarized in Table R1.
Table R1. Configuration differences and estimated total pretraining compute.
| Setting | Scratch EMA-JEPA | TTG-initialized EMA-JEPA | TopoJEPA (vanilla) | TopoJEPA |
|---|---|---|---|---|
| Target Initialization | Random | TTG | TTG | TTG |
| Target Update | EMA | EMA | Frozen | Frozen |
| Prediction | Same-time | Same-time | Same-time | Next-step |
| Spatiotemporal Constraints | ✗ | ✗ | ✗ | ✓ |
| Encoder Size (Context / Target) | 384×12 / 384×12 | 384×12 / 384×12 | 384×12 / 384×12 | 384×10 / 256×8 |
| Epochs (TTG + Prediction) | 0 + 80 | 80 + 80 | 80 + 80 | 80 + 80 |
| Total Compute (×10¹⁸ FLOPs) | 1.716 | 3.108 | 3.108 | 1.796 |
All configurations share the same pretraining corpus, nine topology tokens, time-consistent spatial masking, two-layer predictor (width 192), Smooth L1 loss, and AdamW settings (learning rate 5×10⁻⁴, weight decay 10⁻⁴, global batch size 1,024). Importantly, TTG-EMA and TopoJEPA (Vanilla) share the same TTG checkpoint, encoder architectures (384×12), prediction objective, optimization settings, and total compute (3.108 × 10¹⁸ FLOPs), differing only in target updating. Standard EMA requires matching context and target architectures for parameter updates, whereas Grounding Before Prediction allows greater architectural flexibility. As shown in Section 3.4 and Fig. 3(b), a medium-sized target encoder (256×8) also achieves comparable performance.
Table R2. SEED-V results (balanced accuracy, mean ± standard deviation).
| Configuration | Linear Probing | Full Fine-tuning |
|---|---|---|
| Scratch-EMA | 0.3059 ± 0.0069 | 0.3805 ± 0.0056 |
| TTG-EMA | 0.2961 ± 0.0035 | 0.3703 ± 0.0050 |
| TopoJEPA (Vanilla) | 0.3446 ± 0.0092 | 0.4001 ± 0.0072 |
| TopoJEPA | 0.3729 ± 0.0035 | 0.4157 ± 0.0108 |
We would like to highlight two points.
First, regarding the role of grounding and target freezing, TTG initialization alone does not improve EMA-JEPA over its scratch counterpart. This suggests that the structural prior established during grounding may not be effectively preserved as EMA targets continue to evolve. More importantly, starting from the same TTG initialization, with matched architecture, optimization, and computational budget, TopoJEPA (Vanilla) outperforms TTG-EMA by 4.85 percentage points in linear probing and 2.98 points in fine-tuning. This controlled comparison directly supports the importance of maintaining a fixed grounded target space.
Second, regarding the broader value of grounding, the complete TopoJEPA further improves upon its vanilla version while requiring less computational cost. A fixed grounded target space provides a stable and extensible foundation for incorporating spatiotemporal attention constraints, which we found difficult to combine with EMA-based learning in preliminary experiments. Together with the flexibility of encoder architecture selection (Section 3.4) and the Reconstruction-Specific Auxiliary Branch for separating reconstruction-related information from topology targets (Section 3.5), these advantages represent important motivations for Grounding Before Prediction beyond target freezing alone.
We have incorporated these additional comparisons and computational details into Section 3.4 and Appendix E.1 of the revised manuscript, with the corresponding changes highlighted in blue.
We thank the reviewer for the careful evaluation and constructive comments. To address your concerns, we (1) clarify the methodological contributions of Grounding Before Prediction, (2) provide controlled EMA comparisons with matched initialization, architecture, optimization, and computational budgets, (3) introduce equal-token topology controls and additional cross-task evaluations to further examine the contribution of anatomical grouping, and (4) clarify the implementation of the spatiotemporal attention mask. We provide detailed responses and supporting evidence below. We address your concerns below, and would appreciate it if you would be willing to raise your score if you find your concerns addressed.