- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PairCal, a training-free calibration framework for few-shot cross-subject EEG-to-image retrieval. It consists of two components: Support-Guided Calibration (SGC), which uses paired EEG–image examples to correct query representations through residual kernel regression, and Meta-Distractor Calibration (MDC), which uses leave-one-out reference queries to estimate and suppress candidate-specific attraction. Without updating the pretrained encoders, PairCal achieves improved retrieval performance on the THINGS-EEG dataset.
Critical strengths
-
PairCal addresses the important challenge of adapting pretrained EEG-to-image retrieval models to unseen subjects using limited paired support data, without updating model parameters or accessing other target test queries.
-
PairCal achieves substantial retrieval improvements across held-out subjects, EEG backbones, and support-set sizes. Component ablations and candidate-level analyses provide evidence supporting the effectiveness of the proposed calibration framework.
Critical weaknesses
-
SGC lacks direct quantitative analysis of EEG–visual representation alignment before and after calibration. Although existing analyses suggest that MDC mitigates candidate-side bias, they do not sufficiently examine whether it may over-penalize correct candidates with high attraction scores.
-
SGC closely resembles existing residual kernel regression methods, while MDC shares similarities with established retrieval calibration approaches. More targeted comparisons are needed to establish the distinct contributions of the proposed mechanisms. Furthermore, the evaluation primarily relies on trial-averaged EEG signals and a fixed-size candidate gallery, leaving robustness under more challenging retrieval conditions insufficiently explored.
Questions for authors
-
Is there more direct evidence supporting the relationship between local similarity in EEG representations and the transferability of cross-modal residuals? Can the authors further demonstrate that SGC improves the alignment between paired EEG and visual representations?
-
Although existing experiments suggest that MDC can reduce spurious candidate attraction, its impact on correct matches remains unclear. Could MDC excessively penalize correct candidates with high attraction scores?
3.The paper shows that LOO-based reference queries achieve higher correlations with offline candidate-attraction statistics. Does this advantage translate into improved retrieval performance? Could the authors compare different reference-query construction strategies to better isolate the contribution of the LOO mechanism?
4 comments
Official Comment by Authors
The frozen model achieved a mean paired cosine similarity of 0.3384. After SGC, paired cosine similarity improved consistently across all support sizes, reaching 0.4305 at . Match specificity also increased at every budget, with the improvement growing from +0.0180 at to +0.0611 at . These consistent gains demonstrate that SGC strengthens alignment between EEG embeddings and their corresponding visual representations while improving their relative similarity to matching versus nonmatching images. Together, the residual-prediction, similarity-stratified transfer, and paired-alignment results provide complementary evidence that SGC effectively exploits EEG-conditioned residual information to improve EEG–visual alignment.
W1 / Q2. Over-penalization of high-attraction correct candidates
We grouped gallery images into attraction-score quintiles within each run and assigned each query to the group of its ground-truth image. A harm is a correct SGC Top-1 result that becomes incorrect after applying MDC, and a rescue is the reverse transition.
| Overall harm (%) | Overall rescue (%) | Overall ΔTop-1 (pp) | Highest-attraction 20% ΔTop-1 (pp) | |
|---|---|---|---|---|
| 10 | 2.54 | 3.53 | +0.99 | −5.19 |
| 20 | 2.18 | 3.85 | +1.67 | −4.78 |
| 50 | 2.03 | 4.14 | +2.11 | −4.53 |
| 100 | 2.12 | 5.42 | +3.31 | −2.97 |
| 200 | 2.74 | 7.20 | +4.46 | −4.19 |
The reviewer's concern is borne out in the highest-attraction group. Its Top-1 accuracy decreased at every tested . Among queries that SGC originally retrieved correctly, the highest-attraction group had a harm rate 8.99 to 16.28 percentage points higher than the lowest-attraction group. Across all queries, however, MDC corrected more errors than it introduced at every support size, yielding positive overall Top-1 gains.
The penalty weight governs the size of this effect. When the correct image has a higher attraction score than a competing image, increasing reduces the correct image's score margin over that competitor. We will add the subgroup results and discuss this trade-off in the revision.
W2 / Q3. Methodological contributions and the retrieval benefit of LOO
SGC builds on residual kernel regression by applying it to paired EEG–image embeddings while retaining the frozen EEG query as an anchor. The comparisons with Mean Residual, Similarity-Weighted Residual, and Direct KRR in Table 3 examine the role of the residual estimator and the frozen query anchor. MDC uses the same form of top- candidate correction as NNN. Our additional design is to construct the reference bank by calibrating each support EEG with the other support pairs.
We added final retrieval comparisons using Raw, Full, and LOO reference banks. All methods shared the same SGC query scores, support samples, checkpoints, and candidate galleries across 450 matched evaluation settings. Raw uses the original support EEG embeddings. Full calibrates each reference using all support pairs. LOO excludes the reference's own pair during calibration. Hyperparameters were selected using source-domain validation episodes.
| SGC | SGC + NNN (Raw) | SGC + NNN (Full) | PairCal (LOO) | |
|---|---|---|---|---|
| 10 | 24.99 / 53.74 | 25.60 / 55.22 | 25.70 / 55.02 | 25.98 / 55.62 |
| 20 | 26.79 / 56.73 | 27.72 / 58.25 | 28.05 / 58.13 | 28.46 / 59.24 |
| 50 | 29.48 / 61.29 | 30.50 / 62.13 | 31.27 / 63.25 | 31.59 / 63.44 |
| 100 | 31.78 / 63.04 | 31.93 / 63.31 | 34.61 / 65.86 | 35.08 / 66.50 |
| 200 | 33.44 / 65.55 | 33.86 / 65.70 | 36.93 / 68.78 | 37.90 / 69.81 |
Entries report Top-1 / Top-5 accuracy (%). In a separate ablation, we fixed the SGC queries, scoring rule, neighborhood size, and penalty weight. At , replacing the Full bank with the LOO bank increased mean Top-1 by 1.23 percentage points, with improvements in all 10 subjects. This measures the contribution of the reference construction directly on retrieval performance.
Official Comment by Authors
W2. Scope of the retrieval evaluation
We thank the reviewer for the constructive suggestion regarding evaluation under more challenging retrieval conditions. We agree that robustness to single-trial EEG signals and larger candidate galleries represents an important direction. Nevertheless, we would like to emphasize that our current experimental design follows established practices in EEG-based visual decoding and retrieval, rather than introducing evaluation simplifications specific to our method.
First, regarding trial-averaged EEG signals, averaging repeated EEG recordings corresponding to the same visual stimulus is a well-established practice for improving the signal-to-noise ratio in EEG-based visual decoding. This procedure has been adopted in representative studies, including UBP [1], CognitionCapturer [2], UMind [3], and Img2EEG [4]. In particular, UBP [1] employs trial averaging to improve EEG signal quality, resulting in 16,540 training examples and 200 testing examples per participant. By following this established preprocessing protocol, our evaluation remains consistent with existing methods and focuses on the effectiveness of cross-subject calibration rather than differences in EEG measurement noise.
Second, regarding the fixed candidate gallery, the 200-image gallery is directly determined by the official test partition of THINGS-EEG2 [5], comprising 200 unseen object concepts with one test image per concept. Importantly, we evaluate retrieval against the complete official test gallery rather than a manually selected subset. This 200-way evaluation protocol has been widely adopted in representative studies, including NICE [6], ATM [7], UBP [1], NICE-LLM [8], SATTC [9], and Hierarchical Visual Embeddings [10]. In particular, SATTC [9], which is closely related to our work in investigating cross-subject EEG-to-image retrieval calibration, also reports results under the 200-way leave-one-subject-out evaluation protocol.
Therefore, our use of trial-averaged EEG and the complete 200-image test gallery reflects established benchmark conventions, enabling meaningful and reproducible comparisons with prior research.
We acknowledge that these standard settings do not exhaustively characterize robustness under noisier single-trial inputs or substantially expanded candidate galleries. We will clarify this distinction in the manuscript.
References
- Wu, Haitao, et al. "Bridging the Vision-Brain Gap with an Uncertainty-Aware Blur Prior." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2025.
- Zhang, Kaifan, et al. "CognitionCapturer: Decoding Visual Stimuli From Human EEG Signal With Multimodal Information." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 39. No. 13. 2025.
- Xu, Chengjian, et al. "UMind: A Unified Multitask Network for Zero-Shot M/EEG Visual Decoding." Neural Networks 205 (2027): 109314. Published online in 2026.
- Lu, Zitong, and Julie Golomb. "Img2EEG: A Scalable and Interpretable Encoding Framework for Simulating Human EEG Responses to Visual Inputs." bioRxiv preprint, 2026. DOI: 10.64898/2026.09.16.751610.
- Gifford, Alessandro T., et al. "A Large and Rich EEG Dataset for Modeling Human Visual Object Recognition." NeuroImage 264 (2022): 119754.
- Song, Yonghao, et al. "Decoding Natural Images from EEG for Object Recognition." The Twelfth International Conference on Learning Representations (ICLR). 2024.
- Li, Dongyang, et al. "Visual Decoding and Reconstruction via EEG Embeddings with Guided Diffusion." Advances in Neural Information Processing Systems 37 (NeurIPS). 2024.
- Song, Yonghao, et al. "Recognizing Natural Images From EEG With Language-Guided Contrastive Learning." IEEE Transactions on Neural Networks and Learning Systems 36.9 (2025): 15896–15910.
- Huang, Qunjie, and Weina Zhu. "SATTC: Structure-Aware Label-Free Test-Time Calibration for Cross-Subject EEG-to-Image Retrieval." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 2026.
- Zheng, Jiawen, et al. "Learning Brain Representation with Hierarchical Visual Embeddings." International Conference on Learning Representations (ICLR). 2026.
Official Comment by Authors
Dear Reviewer,
We hope everything is going well for you. We are truly grateful for your thoughtful review and constructive comments on our work. We sincerely hope that our responses have helped address your concerns and would appreciate hearing whether any points still require clarification. If you have any further questions or suggestions, we would be delighted to discuss them with you. Thank you again for your valuable feedback and for the time and effort you have devoted to evaluating our manuscript.
Official Comment by Authors
Response to Reviewer rt1S
We thank the insightful review and would like to address the issue by points:
W1 / Q1. Residual transfer and EEG–visual alignment
Residual transfer. We evaluated EEG-conditioned residual prediction on held-out support pairs. For each held-out pair, we compared the EEG-conditioned prediction with a mean-residual baseline fitted to the remaining support pairs. The leave-one-out residual-prediction skill relative to this baseline was positive at all five support sizes, averaging 0.0830 across budgets, with positive average skill in all 10 subjects. These results support the effectiveness of EEG-conditioned residual prediction on held-out pairs and motivate a more detailed analysis of how residual transferability relates to local EEG similarity.
To directly quantify this relationship, we conducted a controlled single-donor transfer analysis using the original frozen embeddings and support draws. For each held-out support pair i, we transferred another support sample's residual Rj=Ij−Bj and measured the resulting paired-alignment gain:
gij=cos(normalize(Bi+Rj),Ii)−cos(Bi,Ii),i=j.
For each fixed recipient, we divided donors into low-, medium-, and high-similarity tertiles based on their pre-calibration EEG cosine similarity to that recipient, thereby controlling for recipient difficulty across donor groups. We additionally performed 20 image-pair derangements within each recipient's remaining support set, excluding its own pair while preserving the EEG representations and fit-set mean residual. This allowed us to isolate the contribution of correct EEG–image correspondence at different levels of local EEG similarity. Specifically, we defined the controlled interaction as
D=(gtrue−gshuffle)high−(gtrue−gshuffle)low.
Here, gtrue and gshuffle represent the alignment gains obtained with correctly paired and shuffled residuals, respectively. A positive D indicates a stronger pairing-specific transfer advantage among EEG-similar donors. We averaged checkpoint and support-seed repetitions within each subject and estimated confidence intervals using 10,000 paired subject-bootstrap resamples.
Direct single-donor transfer analysis. Values are differences in cosine-similarity gains. Brackets denote pointwise 95% subject-bootstrap confidence intervals.
¹ Budgets were averaged within each subject before cross-subject inference.
The controlled interaction was consistently positive across all five support budgets, with all 10 subjects showing positive differences at every budget. The across-budget average reached +0.0767 [95% CI: +0.0703, +0.0827]. These results provide direct quantitative evidence that the pairing-specific contribution of residual transfer depends on local EEG similarity: correctly paired residuals offer a greater advantage over shuffled residuals when donors are more similar to the recipient in EEG space. This finding supports the role of local EEG structure in guiding residual transfer, consistent with the EEG-conditioned residual prediction employed by SGC.
Paired alignment. We further evaluated how SGC affects EEG–visual alignment on the test set. Specifically, we measured the cosine similarity between each test EEG embedding and its matching image embedding before and after SGC. We also assessed match specificity, defined as the similarity to the matching image minus the mean similarity to all nonmatching images for the same query.