- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper asks whether the facial expressions of a personalized 3D Gaussian head avatar can be decoded from scalp EEG. Six participants perform 75 posed expressions while wearing a 64-channel EEG cap inside a multi-view camera rig, and the avatar’s per-frame expression codes serve as targets. A REVE encoder with a small convolutional decoder maps one-second EEG windows to these codes. The experiments compare EEG foundation models, initializations and channel masks, with models trained and tested within each participant.
Critical strengths
The paired setup is rare: 64-channel EEG synchronized with 26–33 4K cameras, with targets in an avatar latent space, so results can be evaluated in code, mesh and image space. At a larger scale and with good documentation, this would be a useful resource.
Critical weaknesses
W1. Six participants are too few for a dataset contribution
All six participants are male, and the expression data total about 74 minutes, roughly 12 minutes per person (Tab. 1, A.2). No participant is held out for testing (Sec. 5.1). The encoder and depth comparisons use a single participant (Tabs. 2–3), and the six-person averages in Tabs. 4–5 are given without any spread. With this sample I cannot tell whether the conclusions hold beyond these six people, and since the dataset is the first contribution, this is the main reason for my rating.
Recording more people is feasible: EEG is non-invasive, the protocol took about 42 minutes of capture per person (Tab. 1), and recent EEG–video datasets are much larger, e.g., EAV (42 participants; Lee et al., Scientific Data 2024), a mixed-emotion dataset with EEG and face video (73 participants; Yang et al., Scientific Data 2024), EEG2Video (20 participantsLiu et al., NeurIPS 2024) and EgoBrain (40 participants; Lin et al., ICLR 2026). It would help to discuss these paired EEG–video datasets in the related work and make clear what the new dataset adds. I would encourage the authors to record at least 30 participants, add a held-out-participant split, and resubmit.
W2. No control for muscle artifacts, and no trivial baseline
The paper asks whether expressions can be recovered "solely from brain signals" (abstract). However, the kept band (0.5–99.5 Hz) includes the range where muscle artifacts are strong, and apart from amplitude clipping, the preprocessing removes no artifacts (Sec. 4.1). The paper's own observations point the same way: jaw clenches are used for synchronization because they cause large EEG artifacts (A.1), and for seen expressions, masking the temporal or frontal channels hurts most (Tab. 5). The authors themselves note that these channels lie closest to the temporalis and frontalis muscles, where EMG is strongest (Sec. 5.5). There is also no trivial baseline such as predicting the mean face, so I cannot judge how large the effects are.
Questions for authors
Questions marked clarification ask for information that should already be available; those marked additional analysis can be done with the existing recordings.
Q1. Cross-participant generalization (additional analysis)
With the current data, how well does a model trained on five participants work on the sixth (leave-one-subject-out)? The expression codes are disentangled from identity (Sec. 3), so this should be possible without new recordings. Please also report per-participant results, or the spread across the six participants, for Tabs. 4–5.
Q2. Trivial baselines (additional analysis)
What do simple baselines score on the metrics of Tabs. 4–5, for example predicting the mean expression code of the training set, or the neutral face? Without them, it is hard to tell how much of the reported performance comes from the EEG.
Q3. Muscle and eye artifacts (additional analysis)
How much of the performance remains (a) after low-pass filtering below 15–20 Hz, or (b) after removing muscle and eye components with ICA (e.g., ICLabel)? And (c) how does a simple model that uses only high-frequency (>30 Hz) band power, which mainly reflects muscle activity, compare with the full model? These controls would show whether the model decodes brain activity or facial EMG.
Q4. Subtle versus large expressions (additional analysis)
Many of the 75 expression types are large movements, and ten of them involve the tongue (App. B). Do the errors, relative to the mean-face baseline, differ between subtle expressions (e.g., raising an eyebrow) and large ones (e.g., jaw or tongue movements)? Per-expression-type errors from the existing models would be enough.
Q5. Model selection and the proposed decoder (clarification)
REVE and L = 2 were chosen on Subject-03 test sequences (Secs. 5.2–5.3), and Tab. 6 lists no validation split. Was any validation data used to choose the encoder, the decoder depth or the checkpoints, and how many seeds were run? Also, with the encoder frozen, the MLP head in Tab. 2 has lower LPIPS (0.0575 vs. 0.0643), blendshape MAE (0.0238 vs. 0.0434) and mesh MAE (0.725 vs. 1.074 mm) than the proposed decoder with L = 2 in Tab. 3, although it is worse on latent MSE and the landmark loss. Do the two tables use the same input window ("the full EEG input window" in Sec. 5.2 vs. one-second windows in Sec. 5.3) and the same training budget?
Q6. Timing of the demonstration videos (clarification)
Participants perform each expression after a video demonstration (Sec. 3.1). Was the video still on screen during the five-second segments, and how were the expression onsets annotated? For seen expressions, masking the occipital channels also hurts (Tab. 5), so responses to the video itself could contribute to the decoding.
Q7. Data release and ethics (clarification)
What exactly will be released: the full 4 h 15 min of recordings or only the 891 segments, and which of raw EEG, multi-view video and fitted avatars? Under what license and access controls? Did the participants consent to the public release of identifiable face video together with EEG, and was the study approved by an ethics board?