- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies EEG-to-image retrieval for a new subject without using that subject's EEG–image pairings. It first uses source-subject EEG to select a visual feature layer for each dimension across five frozen backbones. It then trains an EEG encoder with source contrastive supervision and three target objectives: information maximization over the training image gallery, moment matching, and contrastive consistency between two halves of repeated responses. The target stimulus set and repetition groups are known, but image identities are withheld. On THINGS-EEG2, the source-only model reaches 37.72% Top-1 accuracy, and SAUNA improves a matched control from 37.25% to 47.77%. Testing uses a 200-image gallery and EEG averaged over 80 repetitions per image.
Critical strengths
-
The adaptation gain is substantial. Top-1 increases by 10.52 percentage points and Top-5 by 9.02 points against the matched control. All ten subjects improve, and the paired Top-1 gains are 11.80, 10.50, and 9.25 points across the three seeds (Table 1).
-
The calibration-budget experiment is useful. Figure 4b reports both the benefit of additional target data and the failure at very small budgets. The two-minute setting reduces accuracy for all ten subjects, identifying a practical limitation at small calibration budgets.
-
The authors disclose several relevant protocol details. The authors explain the target-subject MVNN preprocessing, the history of feature-pool selection, and differences between published baselines. Reporting the final epoch throughout also avoids choosing checkpoints by their test accuracy.
Critical weaknesses
Weakness 1: The added value of the new components is unclear
Most methodological components have close precedents: intermediate-layer supervision, multi-backbone fusion, InfoMax, and covariance alignment are established approaches. Du et al. (2026) also report that preferred visual depths are broadly consistent across subjects. The main methodological additions appear to be per-dimension depth selection and the particular combination of target objectives. Neither addition is tested against the most informative simple control. Table 5 gives 36.4% for a fixed intermediate depth, compared with 37.72% for per-dimension selection, but these results use one and three seeds respectively. In Table 1, InfoMax alone contributes 7.18 of the full 10.52-point gain. The missing InfoMax + CORAL and InfoMax + repetition comparisons would show whether all three terms are needed. The full gain exceeds the sum of the individual gains by only 0.09 points, which is too small to support the claim of synergy without an uncertainty estimate.
Weakness 2: The conclusions extend beyond the conditions tested
All main experiments use ten subjects from THINGS-EEG2. There is no second dataset or cross-session evaluation to test whether the depth preferences and adaptation gains persist under different recording conditions. The method also assumes that target calibration stimuli come from the known training image set and that repeated responses are correctly grouped. Neither assumption is varied in the experiments. It remains unclear whether adaptation retains its benefit under incomplete gallery coverage or repetition-group errors. These tests would directly examine the conditions required by InfoMax and repetition consistency. Without them, the practical claims should be limited to the controlled calibration setting used here.
Weakness 3: The headline comparisons leave important differences uncontrolled
The authors state that the external methods were not rerun and that their preprocessing, electrode sets, and checkpoint selection differ. Although these differences are disclosed, they prevent Table 2 from isolating the proposed method's contribution from protocol differences. The strongest evidence remains the internal matched control. A comparison with a simpler intermediate-layer target and standard adaptation losses under the same setup would be more informative about the contribution. The already-cited SAMGA reports 34.4% cross-subject Top-1, but is absent from Table 2. SAUNA's 37.72% is higher, although the setups differ. This is useful context for the emphasis on the 24.0% baseline; I do not count the absence of an arXiv-only comparison as a reason for rejection. Similarly, the 14.8% SATTC result uses a different encoder and access protocol, so it cannot establish the relative merits of the two adaptation procedures, as the authors acknowledge.
Weakness 4: Table 6 does not explain the variance accounting
For CLIP ViT-B/32, the reported components are 47.6% for shape, 4.1% for subject offset, and 0.7% for interaction. These sum to 52.4%. The other rows likewise account for only about half of the variance. The remaining variance, any residual term, and the denominator used for each percentage are unspecified. The decomposition equation is needed to interpret these values. There is a related ambiguity: Table 6 calls the subject component an “offset” but describes it as a “scale,” while Figure 1b divides each profile by its subject mean. These are different operations. Until their relationship is specified, I cannot assess the interpretation of the small interaction term. Even if that calculation is correct, similar average depth profiles do not establish that subject-specific selection of individual dimensions has no benefit, as the paper suggests.
Weakness 5: The post-hoc experiment changes more than the source anchor
Post-hoc adaptation starts from a trained source model, removes the source loss, and freezes the image mapping. Full SAUNA instead uses the target objectives from the start and trains the image mapping jointly with source supervision. The resulting 40.90% versus 47.77% comparison therefore confounds source supervision, image-mapping updates, and adaptation timing. The lower post-hoc score could reflect the missing source loss, the frozen image mapping, or when adaptation begins. To test the anchor's role, both runs should start from the same checkpoint, use the same number of updates, and treat the image mapping identically, with only the source loss switched on or off. The comparison supports the complete joint-training procedure, but does not isolate the contribution of the source anchor.
Weakness 6: The acquisition and training costs limit the deployment claim
The 47.77% Top-1 result is obtained after averaging 80 EEG repetitions for each test image. Even with that averaging, more than half of the queries are not retrieved correctly at rank one. Despite the substantial benchmark improvement, evaluation with fewer repetitions is needed to support the claims about interactive use. Calibration also takes about an hour to obtain most of the gain, and each new subject requires joint training from scratch with the source data. The paper does not report training time, peak memory, or the end-to-end calibration latency for a new subject. With these costs unmeasured, it is difficult to assess the practical benefit of discarding target image pairings while still requiring a known stimulus set and repetition groups.
Questions for authors
See Weaknesses.
I have not seen a response from the authors. My concerns about the methodological contribution and experimental controls remain unresolved, so I am maintaining my original rating.