- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MuCCA, a framework that leverages complementary neural-visual feature alignment guided by multilevel color representations to improve EEG/MEG-based image retrieval, classification, and reconstruction.
Critical strengths
-
Physiology-inspired decoding of brain signal features is an interesting idea.
-
The experiments cover a good range of tasks.
Critical weaknesses
-
MuCCA uses four independent RPE branches to align with four types of visual representations. When evaluating Top-1, the four branches are collectively allowed to provide up to four candidates, whereas the Top-1 results of other baselines contain only one candidate. This makes the comparison clearly unfair.
-
Similarly, regarding these four RPE branches, rather than taking the Top-1 from each branch, how about taking the Top-4 from each of the four branches separately and comparing which branch is more effective under the same retrieval budget?
-
As the core innovation of this paper, the complementary multi-layer color representations and consistency-constrained auxiliary generation have not been fully justified through ablation studies, including but not limited to those involving the loss functions.
-
Regarding the motivation of this paper, I have one concern: why must the color spaces be LMS, DKL, and CIELUV? These color spaces do describe different color properties, but is there really any clear, established correspondence between the features they extract and physiological mechanisms such as cone responses, as well as EEG/MEG signals? Without explicit support from physiological studies, this motivation seems somewhat unconvincing.
-
The presentation needs improvement. For example, Figure 2 contains a large number of repetitive structures that provide limited additional information.
Questions for authors
please refer to the weaknesses