- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces RASD, a dataset of repeated auditory SEEG recordings from 30 pediatric and adolescent participants, and RCNF, a method for predicting a held-out participant's neural responses from other participants' responses to the same stimuli. RCNF combines repeat-reliability weighting, spatial pooling, equal averaging across source participants, and temporal history with a shared Bayesian-ridge predictor.
The benchmark uses 161 auditory contacts from 21 participants and tests repeat generalization, story–music transfer, and reduced source-electrode coverage. Reliability weighting produces small improvements across four endpoints, while spatial complexity has no corrected advantage over simpler pooling. Prediction requires source neural recordings of the test content; held-participant training-domain recordings are also used for eligibility and scaling.
Critical strengths
- Useful repeated-stimulus dataset design. Shared story and music excerpts, repeated presentations, and electrode coordinates allow response reliability, electrode coverage, and cross-participant transfer to be studied together within one acquisition protocol. This is a potentially valuable resource for evaluating methods across heterogeneous electrode layouts, provided the release includes adequate documentation and quality-control information.
- Additional controls support a limited reliability finding. Appendix E reports that true contact–weight assignments outperform shuffled assignments in the earlier story fold (AUC gain approximately .00172; positive in 20/21 participants). This supports the relevance of which contacts receive the weights, although it is exploratory and does not replace a comparison with learned pooling.
Critical weaknesses
- The benefit over alternative methods and its practical importance remain unclear. The current benchmark compares variants of RCNF, without a learned-pooling alternative. Reliability gains are approximately 0.00069–0.00128 across the four endpoints. Appendix E does provide within-participant repeat correlations, which are useful context, but explicitly notes that they are neither permission-matched predictors nor theoretical ceilings. The practical importance of the incremental gains therefore remains unresolved; low raw correlations alone do not establish poor performance on noisy responses.
- Acquisition provenance and physiological quality control remain incomplete. If playback hardware, acoustic-contamination checks, and treatment of epileptiform activity remain unspecified. These could affect how we interpret the decoding results.
Questions for authors
- Model comparison: Have the authors compared RCNF with lightweight learned pooling, such as Deep Sets or target-conditioned attention, under the same participant splits and calibration budget? An adapted Population Transformer would be another relevant comparison. Does the prescribed weighting offer an advantage over learning how to combine electrodes?
- Acquisition and quality-control clarification: Were stimuli delivered through earphones/headphones or loudspeakers, and at what levels? Could the authors specify the referencing and notch-filter settings? Beyond the stated numerical eligibility rule, how were “signal-valid” contacts identified, and were bad channels, epileptiform activity, and acoustic/equipment artifacts screened? If artifacts were found, how were they handled while preserving neural responses? Acoustic contamination is documented in other intracranial modalities (Roussel et al., 2020); this motivates checking the setup, not assuming these SEEG data are contaminated.
- Effect-size interpretation: Appendix E provides useful within-participant repeat references and explains why they are not theoretical ceilings. Can the authors relate these references more directly to the primary task results, or provide another justified estimate of predictable signal with uncertainty, to help interpret the small calibration gains?
- Dataset contribution: How does RASD complement earlier repeated natural-sound intracranial datasets, particularly Norman-Haignere et al. (2022), and shared speech/music datasets such as Berezutskaya et al. (2022)? Which aspects of its acquisition design or released data enable evaluations that those resources do not?