- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how much learned alignment capacity is needed for EEG-to-visual decoding. Based on the existing ENIGMA architecture, the authors replace its final dense 1024 × 1024 residual transformation with a rank-224 factorization. This reduces the trainable EEG-model parameters by 41.97%, while keeping the remaining architecture and training protocol matched. The main experiment reports that single-trial 200-way retrieval performance is preserved across five development-independent participants and two training seeds. The paper further analyzes representation geometry, effective rank, local image neighborhoods, and downstream image generation under a fixed generator. The question of alignment capacity is meaningful and relevant to the optimization of EEG-to-visual systems. The paper also provides positive results from a reasonably careful experimental study. However, the necessity of the residual transformation and the additional scientific insight from the capacity intervention remain insufficiently established. These issues limit the strength and scope of the paper's main contribution.
Critical strengths
-
A relevant optimization problem with potential scientific value. The paper focuses on how much learned capacity is needed to align EEG representations with a pretrained visual space, rather than only seeking higher retrieval accuracy. This is a useful direction for understanding the design trade-offs of EEG-to-visual decoders. Studying capacity under a fixed visual target and training protocol also provides a clear starting point for isolating this question. (Introduction; Sec. 2.3)
-
A controlled intervention with prospective confirmation. The authors modify a specific residual transformation while keeping the other model components and training conditions matched. The rank-224 configuration and retention criterion are fixed before the confirmation on five development-independent participants, with two training seeds per participant. The reported participant-level and crossed participant/image lower bounds both pass the prespecified −0.5 percentage-point retention margin. This makes the main comparison more informative than a compression result based only on a single run or a post hoc choice of configuration. (Sec. 3.1–3.3; Table 1; Fig. 2; Appendix A.6)
-
The analysis examines several aspects of the learned representation. The authors evaluate ENIGMA–Compact CKA, effective rank, correct-image cosine alignment, and local image-neighborhood overlap at different repetition counts. They also examine retrieval under two repeat-aggregation paths and test downstream generation with shuffled-EEG controls. These analyses provide complementary evidence about the behavior of the compact model beyond the primary Top-1 metric. (Sec. 4–6; Figs. 2–4; Appendices C–E)
-
The paper provides useful diagnostic results and practical measurements. The development-only rank sweep helps contextualize the selected operating point, while the generation experiment reports the boundary between the high-repeat and single-trial settings. The authors also measure parameters, MACs, training time, and inference latency, and distinguish the controlled ENIGMA comparison from the NICE comparison under a different protocol. These details help readers understand both the observed result and its practical scope. (Sec. 6–8; Tables 2–3; Appendix B; Appendix C, Table 7; Appendix F)
Critical weaknesses
-
The necessity of the learned residual transformation is not established. The main experiment compares a dense residual matrix with its rank-224 factorization, but does not include a baseline that removes this specific residual correction. The original ENIGMA paper motivates the skip connection as a way to stabilize training and refine the initial projection, but does not report a direct ablation of this residual correction. Appendix B also shows that rank 64 achieves 7.053% Top-1, close to the 7.067% of rank 224, on the development participants. A zero-residual baseline would help establish how much this component contributes to retrieval and whether the proposed compression preserves a necessary function or mainly simplifies a component that may be less important than assumed. (Sec. 3.1; Appendix B, Table 3)
-
The scientific insight about alignment capacity remains limited. The paper establishes a successful operating point in one existing architecture, but does not identify a minimum sufficient rank or a clear performance boundary. The rank constraint applies only to the learned residual update, while the full 1024-dimensional identity pathway remains available. Theorem 1 establishes the mathematical rank constraint but does not explain why this capacity is sufficient for the retrieval task. A clearer account of what the results reveal about alignment capacity beyond successful compression would strengthen the main contribution. (Sec. 2.3; Sec. 3.1; Sec. 8.1–8.3; Appendix B)
-
The representation analysis does not fully explain why compression works. The CKA, effective-rank, and neighborhood results show that several measured representation properties remain similar after compression. However, both architectures are trained from scratch, so the compact network may adapt to the rank constraint during optimization. The current analysis does not clearly distinguish this adaptation from redundancy in the original residual transformation. Comparing ENIGMA–Compact CKA with CKA between independently trained dense ENIGMA models would provide useful context. The relation between the upstream 184-dimensional representation and the capacity of the final residual correction also deserves further discussion. (Sec. 3.1–3.2; Sec. 5; Fig. 3; Appendix D, Table 8)
-
The evidence supports a narrower conclusion than the broader capacity question suggests. The confirmation is limited to THINGS-EEG2, one visual-target setting, a fixed 200-image gallery, and separately trained participant-specific models. The rank sweep does not systematically test how the required rank changes with EEG repetition count. The generation experiment satisfies the prespecified retention criterion at 80 repetitions, while the crossed lower bound narrowly misses it at one repetition. These results support the tested setting, but the behavior of alignment capacity across other datasets, visual targets, and levels of neural evidence remains unclear. (Sec. 3.2–3.3; Sec. 6; Sec. 8.3; Appendices B, C, and E)
-
The presentation, prior-work positioning, and reproducibility need clarification. The Introduction moves quickly from recent advances in EEG decoding to the alignment-capacity question, without fully establishing the connection between them. The phrase "visual information recoverable from EEG" is also broader than the retrieval-based evidence presented. The relatively short reference list leaves some concern about whether related low-complexity EEG-to-visual mappings and model-compression work are sufficiently distinguished. In addition, the submitted materials do not provide the implementation code for the main ENIGMA/Compact comparison. Finally, the 41.97% parameter reduction corresponds to only about a 4.6% reduction in reported MACs, with nearly unchanged training time and slightly higher measured batch-1 latency. (Introduction; Sec. 2; Reproducibility Statement; Appendix C, Table 7)
Questions for authors
-
Could the authors provide a zero-residual baseline that removes the learned residual correction entirely? Given the similar development performance at ranks 64 and 224, how much does this component itself contribute to retrieval, and what evidence supports the current capacity choice?
-
What exactly does "alignment capacity" mean in this work: residual rank, trainable parameter count, or effective dimensionality of the learned representation? Beyond showing that rank-constrained compression preserves retrieval, what additional scientific insight do the results provide, and can they identify a meaningful capacity boundary?
-
Since both models are trained from scratch, how can the authors distinguish redundancy in the original residual transformation from adaptation or regularization effects introduced by the low-rank parameterization? Could a comparison with independently trained dense ENIGMA models clarify the representation results, and how does the upstream 184-dimensional representation affect the capacity requirement?
-
How far should the findings generalize beyond the current ENIGMA/THINGS-EEG2 setting? Why is single-trial retrieval the primary endpoint, and is there evidence that the capacity behavior changes with EEG repetitions or visual targets? Could the authors also clarify the exact reference implementation and training objective, and provide the main comparison code for independent verification?
Thanks for the efforts. Yet my main concerns remain unresolved. The response narrows the original claim without providing further evidence for the actual capacity requirement or the necessity of the residual correction. I therefore maintain my rating.