- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a zero-shot conditional generative multimodal adapter, ZeroMAG, that uses auxiliary physiological information and unlabeled target-domain signals to adapt the frozen EEG foundation model.
Critical strengths
The main strength of ZeroMAG is that it enhances the model without accessing labeled target-domain data or target-side optimization, and adds multimodal information to frozen EEG foundation models. Also, the evaluation pipeline includes a lot of backbones, datasets, and tasks.
Critical weaknesses
-
The proposed method is too complex to understand, and the ablation studies can not sufficiently prove the necessity of the proposed design.
-
Baselines are too weak to prove the strength.
-
The code is different from the paper’s main text and prevents reproducing the results.
-
The main results and ablation results have a large difference of 3.40%. This mistake impacts the reliability of the proposed method. The average result is 70.01% in Table 1 and Table C.1, but 73.41% in the ablation analysis.
Questions for authors
-
ZeroMAG combines the time-frequency branch, conditional encoding, transformer, VAE, diffusion, and MoE. It uses multiple loss terms in stage I and stage II training but does not sufficiently introduce the necessity of this design.
-
The comparison of baselines is insufficient. The compared baselines now include EEG-only, mean and nearest source weights, and the direct MLP. But the important conditional hypernetworks, adapters, generators, and multimodal alignment approaches on the same source data have not been compared (see Section 4.1 and Table 1).
-
The proposed code is different from their claim in the main paper, including the architecture and training settings, such as the depth of dit and the number of experts. The training source code in stage I not activate the claimed functional supervision loss introduced in 3.4.1. Also, stage II includes extra balance and diversity losses.
-
The main results and ablation results have a large difference of 3.40%. This mistake impacts the reliability of the proposed method. The average result of nine CBraMod/ZeroMAG is 70.01% in Table 1 and Table C.1, but 73.41% in the ablation analysis of Table 2 and G.1. The results of three functional loss ablation studies (70.54%, 71.83%, 72.26%) are higher than the full model results (70.01%). Since the original seed and dataset results are not provided, it is difficult to explain these differences.