- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the impact of the amount of visual information retained in image-side targets and its spatial distribution on model performance during the EEG/MEG–image alignment process. The authors propose AFoB, which uses brain signals and image features to jointly predict the blurring intensity and the extent of two detail-retention regions, and determines the location of an additional retention region based on the center of image salience. Under an evaluation protocol that uses real paired brain signals to construct candidate features, AFoB reported Top-1 and Top-5 scores higher than the UBP baseline on THINGS-EEG and THINGS-MEG. Internal ablation analysis indicates that the contribution of per-sample adaptation is more stable than that of the additional retention region.
Critical strengths
- This paper combines the retention strength of visual information with spatial location as an extension of existing UBP methods, which is reasonably justified.
- AFoB uses a lightweight MLP, adaptive Gaussian blur, and saliency-based localization that requires no additional training; its module design is clear, and it does not require explicit supervision of the blur parameters.
Critical weaknesses
There are some details regarding the methods and the fairness of the experimental protocols that require further discussion. For more details, please see the “Questions” section.
Questions for authors
- According to the definition in Equation 9 of the manuscript, the representation of each candidate image requires the brain signal that truly corresponds to that image. However, in standard EEG-to-image retrieval, we may only have Query: and Gallery: . We do not know the correspondence between and . Therefore, I would like the authors to further explain why they can use ground-truth matched brain recordings to construct candidate image representations and still interpret the results as brain-to-image retrieval. More importantly, the embeddings of the candidate images are no longer determined purely by , but rather by . Consequently, the model’s performance may stem in part from brain-dependent target adaptation and cannot be entirely attributed to its ability to decode brain signals into visual semantics.
- In the Abstract and Tables 1–2, the authors interpret the results as performance improvements relative to UBP. However, Section 4.1 clearly states that UBP uses fixed image reference embeddings during testing; AFoB constructs candidate embeddings using ground-truth paired brain recordings; the numerical differences between the two methods do not prove retrieval improvement under identical evaluation conditions. Therefore, I ask the authors to explain: Given that the evaluation inputs for the two methods are inconsistent, why do the Abstract and Tables 1–2 still present the numerical gap between them as a key result?
- According to the definition in Sec. 3.2, Eq. (2), the prediction of AFoB parameters depends on both the EEG/MEG representation and the image representation. In Section 4.4, Table 3, the ablation experiment conducted after removing the brain input altered two things simultaneously: during the training phase, EEG/MEG was no longer used to predict foveation parameters, and during the testing phase, the candidate embeddings no longer relied on the true, paired held-out EEG/MEG data. Therefore, I believe the current experiment cannot distinguish between training gains and gains from privileged pairing during testing. I hope the authors will include a rigorous control experiment.
Please note: Since I am not an expert in this field, my understanding of the methodological background in this area is limited. Therefore, I suggest that AC adjust my rating as appropriate based on the author’s response to the comments above! As far as I'm concerned, if the author can clearly address the concerns mentioned above, I'd be happy to raise the score to 3. However, please let AC decide on the final rating.