- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
EEGraft edits a source image toward a target using EEG recorded while a participant viewed the target, with no text or masks at inference. A LaBraM encoder aligned to ViT-H features is read by an OmniGen2 editor through two gated cross-attention paths (pooled summary and unpooled tokens), and an auxiliary loss matches the EEG-induced change to the source-target latent difference. The NEVE benchmark (29,275 pairs from three EEG datasets) uses the real stimuli as targets and Gemini-edited versions as sources. EEGraft beats six neural editing baselines on all six metrics, and correct EEG beats null and mismatched EEG.
Critical strengths
- The evaluation is designed with care. Change-region metrics and R-Edit, which gives 0.5 to copying the source, stop whole-image scores from rewarding an edit that does nothing.
- The fixed-editor controls are the right experiment. Correct EEG beats mismatched EEG from the same and from a different participant on all six metrics (C-LPIPS 0.512 to 0.479, C-MAE 0.245 to 0.197), so the recordings do carry some target information.
Critical weaknesses
- The baseline comparison says little about EEG. All six baselines score below source copying on R-Edit (0.275 to 0.386 against 0.5), and LoongX and MindCustomer return blurs and noise in Figure 4. EEGraft with EEG switched off already beats every baseline on every metric (C-LPIPS 0.520 against 0.620), so the 22.7% headline mostly reflects OmniGen2 and in-domain training. The part due to correct EEG is 0.512 to 0.479 in C-LPIPS. The source-only editor (Table 5, R-Edit 0.480) also looks undertrained next to the null-EEG model (0.521).
- The benchmark may not test target-specific decoding. Sources are Gemini edits of the target photo, so the editor learns to undo one synthetic recolor or replacement. Neither mismatch control holds the concept fixed, so the gap may reflect category information rather than the target's appearance, which is what appearance edits need. On the 200 official THINGS images R-Edit is 0.527, barely above copying.
Questions for authors
- Clarification: was the source-only editor trained with the same steps, losses and LoRA settings as EEGraft, and why does it fall below copying?
- Experiment: Correct versus Mismatched gaps per subset with confidence intervals over participants, plus a same-concept mismatch control.
- Clarification: is the Table 16 retrieval single-trial or averaged, and is each edit conditioned on one trial?
- Experiment: a decode-then-edit baseline on the same backbone (EEG to ViT-H embedding, then OmniGen2 image conditioning) would show whether the dual readout matters.
5 comments
W2 — Target-specific EEG information and benchmark construction
Thank you for raising the concern about target-specific decoding. To address your concern about source-image regularities, we replaced Gemini with gpt-image-2.5 under the same construction protocol, which constrains edits to be plausible and preserves unrelated content (Appendix A). We kept the target–EEG pairs unchanged and evaluated the same trained editor without fine-tuning, holding source images fixed across EEG conditions within each task.
\hline \text{EEG condition}&\text{T-LPIPS ↓}&\text{C-LPIPS ↓}&\text{C-MAE ↓}&\text{C-SSIM ↑}&\text{PixCorr ↑}&\text{R-Edit ↑}\\\\ \hline \text{Null EEG}&0.322&0.531&0.251&0.381&0.687&0.517\\\\ \text{Mismatched EEG}&0.313&0.527&0.255&0.384&0.691&0.526\\\\ \text{Correct EEG}&\mathbf{0.280}&\mathbf{0.476}&\mathbf{0.194}&\mathbf{0.422}&\mathbf{0.748}&\mathbf{0.583}\\\\ \hline \end{array}$$ Correct EEG outperforms both controls, reducing C-MAE by **23.9%** relative to Mismatched EEG and **22.7%** relative to Null. Its R-Edit remains **0.583**, compared with **0.585** on the original sources, demonstrating that the EEG benefit persists across source generators. We further tested **Same-category attribute-mismatched EEG** on test subsets supporting this comparison, holding the model, source image, participant, and target category fixed while substituting EEG from a target with different attributes. **Appearance editing.** $$\begin{array}{lrrrrrr} \hline \text{EEG condition}&\text{T-LPIPS ↓}&\text{C-LPIPS ↓}&\text{C-MAE ↓}&\text{C-SSIM ↑}&\text{PixCorr ↑}&\text{R-Edit ↑}\\\\ \hline \text{Same-category attribute-mismatched EEG}&0.217&0.363&0.189&0.523&0.766&0.572\\\\ \text{Correct EEG}&\mathbf{0.190}&\mathbf{0.347}&\mathbf{0.169}&\mathbf{0.544}&\mathbf{0.848}&\mathbf{0.615}\\\\ \hline \end{array}$$ **Semantic editing.** $$\begin{array}{lrrrrrr} \hline \text{EEG condition}&\text{T-LPIPS ↓}&\text{C-LPIPS ↓}&\text{C-MAE ↓}&\text{C-SSIM ↑}&\text{PixCorr ↑}&\text{R-Edit ↑}\\\\ \hline \text{Same-category attribute-mismatched EEG}&0.428&0.673&0.244&0.239&0.591&0.522\\\\ \text{Correct EEG}&\mathbf{0.396}&\mathbf{0.656}&\mathbf{0.235}&\mathbf{0.254}&\mathbf{0.623}&\mathbf{0.544}\\\\ \hline \end{array}$$ Correct EEG improves all six metrics in both tasks, including C-MAE reductions of **10.6%** for appearance and **3.7%** for semantic editing, demonstrating target-specific information beyond category cues. On the **200 Official THINGS test images**, Correct EEG also reduces C-MAE from **0.279 to 0.228** and raises R-Edit from **0.487 to 0.527** relative to Mismatched EEG with the editor, source images, and participant fixed. This set contains one stimulus per concept, so within-concept attribute mismatches are unavailable. --- ## Q1 Source-only training and the source-copy reference Thank you for asking about the source-only training setup. To clarify the training comparison, the source-only editor matches EEGraft's OmniGen2 initialization, data, optimization protocol, LoRA settings (rank 32, dropout 0.05), and training steps (**2,400 for appearance and 3,000 for semantic editing**). It retains the same flow, endpoint, and decoded-image target-recovery objectives. Prediction-difference supervision matches the EEG-induced prediction change to the source-to-target displacement; we set **$\lambda_\Delta=0$** because source-only has no EEG condition to switch on or off. R-Edit assigns **0.5** to copying the source without correcting it; exceeding this reference requires target-region recovery to outweigh added preservation error. Without target EEG, source-only relies on source cues and learned visual priors. Its recovery gains do not offset that error, yielding R-Edit of **0.494 for appearance and 0.461 for semantic editing** (**0.480 overall**).Q2 Task-wise EEG gaps and same-concept mismatch
Thank you for requesting task-wise gaps, participant-level uncertainty, and a same-concept control. We report Correct–Mismatched differences on the complete 1,600-pair appearance and 1,200-pair semantic test sets, with the checkpoint, source images, and evaluation protocol fixed within each task.
We estimated 95% confidence intervals for using 10,000 paired participant-cluster bootstrap resamples, stratified by dataset, retaining each sampled participant's observations and condition pairing. Each resample follows the original metric aggregation, computing R-Edit from summed errors before taking the ratio. Collateral denotes added target error in regions to be preserved relative to the source.
\hline \text{Metric}&\text{Appearance Δ}&\text{Appearance 95\\% CI}&\text{Semantic Δ}&\text{Semantic 95\\% CI}\\\\ \hline \text{T-LPIPS ↓}&\text{−0.032}&\text{[−0.037, −0.026]}&\text{−0.025}&\text{[−0.030, −0.021]}\\\\ \text{C-LPIPS ↓}&\text{−0.027}&\text{[−0.034, −0.021]}&\text{−0.041}&\text{[−0.045, −0.038]}\\\\ \text{C-MAE ↓}&\text{−0.051}&\text{[−0.060, −0.043]}&\text{−0.044}&\text{[−0.048, −0.040]}\\\\ \text{C-SSIM ↑}&\text{+0.040}&\text{[+0.029, +0.052]}&\text{+0.033}&\text{[+0.028, +0.039]}\\\\ \text{PixCorr ↑}&\text{+0.054}&\text{[+0.042, +0.067]}&\text{+0.068}&\text{[+0.063, +0.073]}\\\\ \text{R-Edit ↑}&\text{+0.059}&\text{[+0.051, +0.067]}&\text{+0.045}&\text{[+0.040, +0.051]}\\\\ \text{Collateral ↓}&\text{−0.005}&\text{[−0.009, −0.002]}&\text{−0.010}&\text{[−0.013, −0.006]}\\\\ \hline \end{array}$$ All intervals favor Correct EEG in both tasks, showing improved target recovery alongside lower collateral error. The requested same-category attribute-mismatch control is reported in W2, where holding category fixed confirms target information beyond category cues. ## Q3 EEG trial averaging for retrieval and editing Thank you for requesting clarification on the EEG input protocol. We understand the importance of specifying how many recordings condition each result. Both Table 16 retrieval and editing use EEG signals averaged over four trials from the same participant viewing the same stimulus. Averaging is performed at the EEG signal level, before encoding, to reduce trial-to-trial noise and stabilize stimulus-related responses. Each edit is conditioned on this four-trial average. ## Q4 Decode-then-edit with the same backbone Thank you for suggesting a decode-then-edit comparison on the same backbone. We implemented it with the same frozen EEG decoder, mapping its 1,024-dimensional ViT-H embedding through a learned bridge to a VAE reference latent for OmniGen2's native reference-conditioning pathway. Both methods use the same backbone initialization, data splits, LoRA settings, editing losses, training steps, and inference and evaluation protocols, receiving only the source image and EEG at inference. The intermediate visual representation may leave local correction details underspecified, whereas EEGraft lets source-conditioned visual states directly read both the aligned summary and unpooled EEG features. $$\begin{array}{lrrrrrr} \hline \text{Method}&\text{T-LPIPS ↓}&\text{C-LPIPS ↓}&\text{C-MAE ↓}&\text{C-SSIM ↑}&\text{PixCorr ↑}&\text{R-Edit ↑}\\\\ \hline \text{Decode-then-edit}&0.432&0.623&0.281&0.257&0.533&0.545\\\\ \text{EEGraft}&0.278&0.479&0.197&0.420&0.752&0.585\\\\ \hline \end{array}$$ Decode-then-edit achieves positive net editing performance with R-Edit of 0.545. EEGraft improves all six metrics, reducing C-MAE by 29.900% and raising R-Edit to 0.585, demonstrating better target recovery and recovery–preservation balance under the same decoder and backbone. The matched concatenation control in W1 further tests readout organization using the same summary and unpooled features; separate readouts improve R-Edit by 0.056.
We thank the reviewer for the careful reading and detailed feedback, particularly the suggestions for controlled comparisons that we have incorporated into the experiments and analyses below.
W1 — Baseline quality and the contribution of EEG
Thank you for highlighting the concerns about baseline quality and the contribution of EEG. All six baselines were adapted to target-viewing EEG on NEVE and fully optimized for both appearance and semantic editing under a common evaluation protocol, preserving their core editing mechanisms (Appendix L).
Source images provide scene structure and content to preserve, which OmniGen2 continues to use through its NEVE-trained source-conditioning pathway when EEG is disabled. External methods also receive the source, but their editing mechanisms may be less effective at translating target-related EEG into precise local corrections while preserving unrelated content. For example, Brain-Supervised, the strongest external baseline on R-Edit at 0.386, maps EEG-derived attributes to source-conditioned updates. Attribute-level guidance can leave spatial and appearance details underspecified; edit-magnitude calibration adjusts update strength without supplying those details. R-Edit exceeds the source-copy reference of 0.5 only when target recovery outweighs additional preservation error within each editing subset. Figure 5 evaluates both sides of this balance and shows that EEGraft achieves stronger target recovery and less additional error in low-change regions than the external methods.
The reported 22.7% C-LPIPS reduction, from 0.620 to 0.479, compares complete editing systems. With the same OmniGen2 backbone, EEG representations and training protocol, and matched readout capacity, separate readouts reduce C-MAE by 13.2% and raise R-Edit by 0.056 relative to concatenation. Q4 further reports the requested decode-then-edit comparison using the same backbone and EEG decoder.
We then hold the learned editor fixed to measure the information supplied by the target's EEG at inference. Null, Mismatched, and Correct EEG use the same full-model checkpoint within each task, source images, and evaluation protocol. Null disables both EEG readouts; Mismatched replaces the correct recording with EEG from another stimulus viewed by the same participant.
\hline \text{EEG condition}&\text{T-LPIPS ↓}&\text{C-LPIPS ↓}&\text{C-MAE ↓}&\text{C-SSIM ↑}&\text{PixCorr ↑}&\text{R-Edit ↑}\\\\ \hline \text{Null EEG}&0.310&0.520&0.242&0.386&0.696&0.521\\\\ \text{Mismatched EEG}&0.307&0.512&0.245&0.383&0.692&0.532\\\\ \text{Correct EEG}&\mathbf{0.278}&\mathbf{0.479}&\mathbf{0.197}&\mathbf{0.420}&\mathbf{0.752}&\mathbf{0.585}\\\\ \hline \end{array}$$ Correct pairing reduces C-LPIPS by **6.4%** and C-MAE by **19.6%** relative to Mismatched EEG, while increasing R-Edit by **0.053**. Relative to Null, C-MAE falls by **18.6%** and R-Edit rises by **0.064**, demonstrating better target recovery and recovery–preservation balance with the source and learned editor fixed. Task-wise results and participant-level confidence intervals are reported in Q2. The source-only editor uses the same OmniGen2 initialization and is fully trained with matched data, training budgets, LoRA settings, and optimization protocols (Q1). It retains the target-recovery objectives and sets $\lambda_\Delta=0$, since prediction-difference supervision requires an EEG condition to switch on or off. Null instead retains the shared LoRA learned during EEG-conditioned training. To distinguish these training effects, we compare Source-only, No-Δ and Full with EEG disabled at inference; No-Δ removes $L_\Delta$ while keeping all other training settings unchanged. $$\begin{array}{lrrr} \hline \text{Model without EEG at inference}&\text{C-LPIPS ↓}&\text{C-MAE ↓}&\text{R-Edit ↑}\\\\ \hline \text{Source-only}&0.632&0.317&0.480\\\\ \text{No-Δ, Null EEG}&0.641&0.305&0.518\\\\ \text{Full, Null EEG}&0.520&0.242&0.521\\\\ \hline \end{array}$$ Even without $L_\Delta$, the conditionally trained editor reaches R-Edit of **0.518** with EEG disabled, compared with **0.480** for Source-only. Adding $L_\Delta$ further reduces Null C-LPIPS by **18.9%** and C-MAE by **20.7%**, while increasing R-Edit from **0.518 to 0.521**. These gains persist because Null uses the learned shared LoRA; stop-gradient blocks the difference loss through the EEG-disabled prediction, but the conditioned prediction still updates those shared parameters. Conditional training therefore produces a retained R-Edit advantage, and difference supervision further improves target-region recovery. ---