- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces a geometry-conditioned EEG source-imaging model that processes varying electrode layouts without requiring a supplied leadfield at inference. It predicts parcel waveforms and uses an autoregressive decoder to sample variable-size sets of active cortical parcels. Experiments on synthetic data demonstrate improved source localization, support recovery, and transfer to unseen montages. Evaluation on Localize-MI further shows encouraging transfer to real stimulation-evoked EEG.
Critical strengths
Montage-flexible source imaging. The model uses EEG signals and electrode coordinates to handle varying channel counts and unseen layouts with shared parameters, reducing dependence on montage-specific models and externally supplied leadfields.
Structured support uncertainty with strong validation. The autoregressive decoder represents distributions over variable-size active-parcel sets rather than only independent parcel scores. Extensive synthetic experiments, ablations, and real-data evaluation provide encouraging evidence for localization accuracy, montage transfer, and uncertainty quality.
Critical weaknesses
The experiments do not isolate the claimed benefit of autoregressive dependence modeling. OursAR and OursInd learn different marginal inclusion probabilities, and the paper explicitly acknowledges that the comparison therefore establishes only the performance of the complete models. The energy-score difference between them is also small (1.576 versus 1.585). The considerably better excess AURC of OursAR may arise from changed marginals or localization-error distributions rather than learned parcel dependencies. Since autoregressive support sampling is a central contribution, a comparison that controls the marginals—or another direct measure of joint support modeling—is needed to establish that dependencies themselves are consequential.
Questions for authors
Clarification that could affect my assessment: Can the authors provide a baseline that preserves, or is explicitly fitted to, the parcelwise marginals of OursAR while removing dependencies between parcels? Alternatively, can they directly evaluate held-out joint-support likelihood, pairwise co-inclusion quality, cardinality calibration, or another statistic that distinguishes joint modeling from improved marginals?
2 comments
Thank you again for your positive review and for the precise question on the role of the dependencies. Following your suggestions, we ran baselines that keep the parcelwise marginals of OursAR while removing the dependencies, together with cardinality and set-level calibration analyses. We hope these results clarify the contribution of the autoregressive decoder and would be happy to discuss any remaining points. If they address your concern, we would be grateful if you considered raising your score.
We would like to thank the reviewer for pointing out these aspects. We agree that OursAR and OursInd learn different marginals, so Table 4 only compares complete models (as in Sec. 4.5 and Appendix F). For this reason we followed both of your suggestions, running everything without retraining on the same Table 4 subsets (1k scenarios per simulator, three seeds).
On your first question, we built baselines that keep OursAR's parcelwise marginals exactly and remove the dependencies. For each EEG we start from that EEG's own OursAR draws and either shuffle each parcel's column of the draw matrix independently, which keeps every inclusion frequency and destroys all co-occurrence, or draw each parcel independently with probability π^r. We then repeated the excess AURC analysis of Table 4 with these samplers. There, the error is the peak of the point estimate built from the marginals, and EEGs are ranked by the spread of the draw centroids. With the marginals held fixed the errors are identical, so any change comes from the ranking alone:
Removing the dependencies alone costs 9.5 mm (paired bootstrap 95% CI [-11.1, -7.8]), while the mean spread barely moves (10.75 vs 10.69 mm), so the dependencies change which EEGs the model marks as uncertain. Your suspicion is partly right. About two thirds of the gap to OursInd (from 83.1 to 64.0) comes from better marginals, and the remaining third (from 64.0 to 54.5) from the dependencies.
On your second question, we went through the statistics you list, comparing OursAR with the same matched baselines (500 draws per EEG, Brier scores corrected for the finite number of draws, 95% CIs in brackets).
We did not compute held-out joint-support likelihood, because it would not compare the two models fairly. The probability OursAR assigns to a set is a sum over all the orderings that produce it (Eq. 3), which is intractable, and the teacher-forced likelihood of a single ordering is only a lower bound, whereas the likelihood of the independent sampler is exact.
For pairwise co-inclusion, we scored the 45 pairs among the ten most probable parcels of each EEG. Here the dependencies do not help: OursAR minus the matched sampler is +0.0004 [+0.0003, +0.0005] on the pair Brier score. Cardinality calibration is where they matter. On the Brier score of the number of active parcels the difference is -0.0064 [-0.0101, -0.0025] in favour of OursAR, which is consistent with the STOP token learning the count directly, while an independent sampler is tied to a Poisson-binomial count. The energy score, by contrast, differs by only 0.1% (+0.0019 [+0.0008, +0.0030]), because it mostly reflects the marginals, and this is why OursAR and OursInd looked so close in Table 4.
As a further statistic we looked at the calibration of support sets. For each EEG we take the smallest set of top-ranked parcels whose predicted probability of containing the whole true support reaches p, and check how often it actually does. At p = 0.5 OursAR covers at the stated rate (0.53) with a median of 39 parcels, whereas the independent sampler over-covers (0.68) and needs 205 parcels, and this holds in both simulators (TVB 0.53 vs 0.71, SEREEGA 0.52 vs 0.65). At p = 0.8 and 0.9 both under-cover (0.75 and 0.80 for OursAR, 0.78 and 0.82 for the independent sampler), because the event requires every weak peripheral parcel, and we will report this as a limitation.
Overall, the dependencies improve error ranking, cardinality calibration and set calibration at moderate p, but not pairwise co-inclusion or the energy score. We propose to add this control as Appendix D.5, add the matched rows to Table 4, and describe the contribution of the dependencies in these terms.