- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the lack of subject-level paired EEG and audio-text interview data in depression recognition and proposes a framework called NeuroInject. The proposed method introduces a shared clinical-state module into the intermediate layers of a pretrained audio-language model, enabling cross-modal knowledge transfer through shared parameters. Experiments on four depression recognition datasets show that the proposed method outperforms the compared baselines in terms of classification accuracy.
Critical strengths
S1. Practical Significance of the Research Problem Collecting paired multimodal data from the same subjects is challenging in real-world clinical depression recognition scenarios. Therefore, the problem addressed in this paper, involving the lack of paired EEG and audio-text data, is of practical significance.
S2. Well-Motivated Architectural Design The proposed intermediate clinical-state injection mechanism provides a shared learning framework for heterogeneous modalities without requiring sample-level alignment, while preserving separate processing pathways for different modalities.
Critical weaknesses
W1. Insufficient Evidence of Cross-Modal Knowledge Transfer The current experiments only demonstrate the effectiveness of the proposed architecture. The paper lacks a direct comparison between single-modality training and multimodal joint training, and thus does not provide sufficient evidence of effective cross-modal knowledge transfer. Based on the existing results, it remains unclear whether the performance improvements come from knowledge transfer or simply from adopting a more complex model architecture.
W2. Insufficient Experimental Evaluation The ablation studies only evaluate the intermediate interaction mechanism and Direct State Fusion on EEG datasets, without independently examining the contributions of other key components, such as shared clinical-state updates, cross-attention, and shared LoRA. Furthermore, the two EEG test sets contain only 11 and 9 subjects, respectively, resulting in relatively small evaluation sample sizes.
Questions for authors
Could the authors conduct the following additional experiments?
- Single-modality vs. joint training: Provide a controlled comparison between single-modality training and multimodal joint training under the same NeuroInject architecture. This would help clarify whether the performance improvements come from cross-modal knowledge transfer or the architecture itself.
- More comprehensive ablation studies: Conduct more detailed ablation studies on key components, such as shared clinical-state updates, cross-attention, and shared LoRA. Additionally, could the ablation studies be extended to the audio-text datasets?