- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes NeuroPrompt, a framework for emotion-aware dialogue generation that uses EEG-derived emotional information to adapt LLM responses. To address the lack of synchronized EEG–dialogue datasets, the authors introduce a staged training framework consisting of emotion representation learning with an EEG encoder, projection into the LLM embedding space, and EEG-conditioned response generation using soft prompts. The proposed approach is evaluated through offline experiments, human evaluations, and an online user study with real EEG recordings, demonstrating improvements in emotion-aware response generation.
Critical strengths
S1. Meaningful problem setting: Leveraging EEG to capture emotional information that may not be explicitly expressed in dialogue text is an interesting problem with potential practical value for emotion-aware LLM-based interaction.
S2. Evaluation with real users: In addition to LLM-based evaluations, the authors conduct human evaluations and an online EEG study involving 18 participants. These experiments provide valuable evidence of the approach's effectiveness under more realistic interaction settings.
S3. Baseline comparisons and acknowledgment of limitations: The paper includes comparisons with hard-label control and a gold-label oracle, along with ablation studies of the staged training framework. The authors also explicitly acknowledge limitations, including the binary emotion setting and reliance on non-synchronized EEG–dialogue training data.
Critical weaknesses
W1. Insufficient comparison with probability-based EEG conditioning: Although the proposed approach outperforms hard-label control, this comparison alone does not sufficiently establish the benefits of using high-dimensional EEG representations. Since the task involves binary POS/NEG classification, a straightforward alternative would be to use calibrated class probabilities from the EEG classifier as conditioning inputs to the LLM. Furthermore, because the EEG and dialogue data are paired solely through binary emotion labels, a probability-based approach represents a particularly important baseline. The current results do not clarify whether the improvements arise from preserving richer EEG representations or simply from avoiding the information loss caused by hard-label discretization.
W2. Limited methodological novelty: The proposed framework primarily combines existing techniques, including EEG encoders, projectors, soft prompts, LoRA-based LLM adaptation, and staged training. Although applying EEG-based emotional information to dialogue generation is an interesting direction, the methodological contribution beyond existing techniques remains unclear, particularly in light of related studies such as Thought2Text, E²-LLM, and NeuroChat.
W3. Concerns about the fairness of the Text-Only Baseline: The Text-Only Baseline is trained using emotion labels, but the emotion-conditioning input is removed at inference time. This differs from a model trained exclusively on dialogue text from the beginning, and the resulting mismatch between training and inference conditions may affect its performance. A comparison with a text-only model fine-tuned without emotion conditioning, using matched training data and computational budgets, is necessary to establish the benefits of EEG conditioning more convincingly.
Questions for authors
Q1. Probability-based conditioning: Have the authors evaluated a baseline that uses calibrated POS probabilities from the EEG classifier as conditioning inputs to the LLM? In particular, would the proposed method still outperform a probability-based approach that generates soft-prompt embeddings from the classifier's probability output while maintaining the same soft-prompt architecture?
Q2. Methodological novelty: Could the authors clarify the fundamental methodological contribution of the proposed staged training framework beyond existing EEG–LLM integration and emotion-conditioned dialogue generation approaches? In particular, which experimental results demonstrate advantages that cannot be achieved using existing conditional learning techniques?
Q3. Text-Only Baseline: Have the authors compared the proposed approach with a text-only model fine-tuned without any emotion-conditioning input during training, under matched data and computational budgets? If so, does EEG conditioning still provide consistent improvements over this baseline?