- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes an end-to-end asynchronous EEG decoding framework named DANCE, which reformulates neural event detection and classification modeling as a set prediction problem. The authors conducted extensive evaluations across six task domains and ten public datasets, comprising a total of 1,154 participants and 2.35 million events.
Critical strengths
- Advance EEG decoding from classification based on idealized alignment windows to realistic scenarios involving asynchronous, continuous event detection.
- Successfully integrated the set prediction concept from computer vision (the DETR architecture) with Perceiver's flexible temporal-scale resampling mechanism.
- The evaluation is exceptionally robust, spanning 10 public datasets, 6 distinct task domains, and over 2.35 million events; it compares 7 different baselines and includes comprehensive ablation studies.
Critical weaknesses
- The core components of DANCE are built upon existing frameworks—specifically CNN, Perceiver, and DETR-style set prediction architectures; therefore, it is necessary to further elucidate the key methodological innovations tailored to the specific characteristics of EEG data, rather than merely presenting a combination of existing modules.
- The paper employs a combination of temporal IoU thresholds and class consistency to determine correct event detections. However, given the significant variations in event duration, event density, and localization difficulty across different tasks, the use of a single evaluation threshold may compromise cross-task comparability.
- Although the model was evaluated on multiple datasets, independent training configurations were used for each, and the authors noted that joint training has not yet yielded performance gains. Consequently, while the results demonstrate the architecture's adaptability to various tasks, they are insufficient to prove a unified capability for cross-task generalization.
Questions for authors
- The papers cover events ranging from short-duration speech-related events (approximately 0.08 seconds) to clinical events lasting tens of seconds or even minutes; there are significant differences across tasks regarding event duration, density, and boundary annotation characteristics. Applying a uniform IoU threshold of 0.5 may result in varying levels of actual strictness for the metrics across different tasks.
- If DANCE employs independently trained models for each dataset, it does not operate on the same comparative basis as large-scale, pre-trained EEG foundation models, which aim for universal representations and cross-task transferability. Consequently, one cannot conclude that this architecture possesses superior generality or is better suited for general-purpose neural decoding based solely on independent test results across datasets.
- For events spanning a vast range of durations (from 0.08-second phonemes to 67.7-second epileptic seizures), does a fixed sensitivity for box regression boundaries lead to imprecise boundary localization for long events or severe localization jitter for short events?
If the author addresses the questions above, I will raise my score.
2 comments
Thank you for addressing my questions—best of luck to you! I will increase my rating.
Thank you for your review. Here are our answers, in order.
1. IoU 0.5. We selected this metric as this is a demanding test. IoU divides the overlap by the length of the events, so a threshold of 0.5 asks for the same relative precision from an 80 ms phoneme and a 60 s seizure; a tolerance in seconds would be loose for seizures and out of reach for phonemes. F1event decreases smoothly with the threshold, with no cliff at 0.5 (Fig. A.1A). Across all methods, DANCE has the highest mean F1event at every threshold from 0.1 to 0.9, and its lead grows as the test gets stricter (1.8× at 0.1, 3.5× at 0.5, 4.7× at 0.9).
2. Generality. We agree that per-dataset training shows that the architecture adapts to each task, not that one model generalises across tasks. Our goal is to propose a recipe, not a pretrained model. On a new dataset, DANCE tests detection and classification from scratch, without pretraining, by setting two parameters (window and number of queries), with a rule for the window (App. A.3); we did this on ten datasets in six domains. It is also complementary to foundation models: our decoder turns pretrained REVE into an event detector (see our answer to Reviewer 9s8k). We have now made this explicit in the Discussion.
3. Boundaries. The window is set from the event length (8 s for phonemes, 256 s for seizures), and boundaries are predicted relative to the window, so precision scales with event duration. The median boundary error is about one latent token (23–129 ms) on six datasets, 1–2% of trial length in motor imagery, and 11% of seizure length. DANCE's relative error is lower than that of the best baseline on all ten datasets.
4. EEG-specific design. We agree that DANCE builds on existing modules. What is new is how each one addresses a property of EEG:
Together, these let one recipe beat seizure-specific models on TUSZ without post-processing. Our goal here is to propose a reference architecture and to push the community to consider this problem, which is mostly overlooked in the literature.