- Rating
- 3(+1)
- Confidence
- 2(−1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
CoMA-DiT augments EEG and EOG representations through bidirectional cross-modal attention and gated residual perturbations, trained with a velocity-prediction auxiliary objective. A second stage adapts the classifier using real and augmented latents. Evaluation on AVGC and DEAP reports improvements in auditory attention decoding and emotion recognition under within-subject chronological splits.
Critical strengths
- The approach improves two task-specific backbones across auditory attention and emotion recognition. The augmentation module is unnecessary at inference, making the reported gains practically relevant.
- Splitting recordings before windowing addresses an important leakage risk. The loss and architectural ablations in Tables D1-D2 provide useful evidence about the gate, bidirectionality, and auxiliary objectives.
Critical weaknesses
- The role of diffusion is not established clearly. Equations (4)-(5) produce augmentation through a separate residual head on noisy Transformer features, rather than a stated reverse-flow sampling procedure. The velocity loss therefore appears to act as auxiliary regularization. Removing it still gives 79.65% AVGC accuracy versus 80.52% for the full model and 76.24% for DARNet. This leaves much of the gain explainable by ordinary learned residual augmentation. Neither the derivation nor the experiments establish a distinct generative mechanism.
- The strength and scope of the empirical evidence need qualification. Appendix D.4 treats 36 subject--seed pairs as observations, although runs from the same 12 subjects are clustered. This can overstate significance across subjects. All evaluations are within-subject and use EEG-EOG, so they do not establish generalization to unseen subjects or other modality combinations.
Questions for authors
- Is any reverse diffusion or flow integration used to produce augmented latents? If not, how does the method compare with the same noisy cross-attention residual network trained without velocity prediction, under a matched training budget?
- Do the gains remain significant after averaging seeds within each subject or using a subject-clustered analysis? Please also clarify which reported evidence supports the broader generalizability claim.
17 comments
W1 — Actual reverse-flow augmentation and task-dependent results (2/3)
Reverse: explicit conditional velocity integration. For the direction , CoMA-DiT (Reverse) starts from a partially noised observed target, , while keeping the paired source fixed. It integrates the learned source-conditioned velocity field from to using Heun predictor–corrector updates. Writing for the integrated endpoint, the augmentation is
\mathbf{Z}^{a+}=\mathbf{Z}^{a}+\Delta_{\mathrm{Rev}}.$$ Thus, **Reverse constructs its augmentation from the numerically integrated conditional velocity field**, whereas Single-Pass uses a direct residual head. Because Reverse starts from a partially noised observed target, it performs conditional augmentation rather than unconditional synthesis from pure noise. Both directions of EEG–EOG augmentation are retained, and neither path is required at inference. We also clarify that Reverse uses an endpoint-derived residual and different reliability-gate inputs, so the comparison evaluates the two implemented augmentation paths. We report both paths and their unaugmented backbones on four settings. All entries are mean ± SD (%); the full four-metric results appear in Appendix A.5, Table A2. | Dataset | Backbone accuracy | Single-Pass accuracy | Reverse accuracy | Single-Pass macro-F1 | Reverse macro-F1 | | --- | ---: | ---: | ---: | ---: | ---: | | AVGC | 76.24 ± 4.11 | **80.52 ± 3.82** | 79.73 ± 3.40 | **80.39 ± 3.82** | 79.58 ± 3.48 | | DTU | 83.38 ± 1.63 | **87.31 ± 1.62** | 86.10 ± 1.44 | **86.72 ± 1.70** | 85.74 ± 1.51 | | DEAP-A | 94.92 ± 1.78 | 97.17 ± 1.18 | **97.98 ± 1.36** | 96.86 ± 1.33 | **97.40 ± 1.58** | | DEAP-V | 95.11 ± 1.63 | 97.47 ± 0.92 | **97.84 ± 1.56** | 97.37 ± 0.95 | **97.65 ± 1.64** | Both paths improve their corresponding backbones. Single-Pass has higher mean accuracy on AVGC/DTU by **0.79/1.21 points**, whereas Reverse has higher means on DEAP-A/DEAP-V by **0.81/0.37 points**. These task-dependent rankings suggest that explicit integration provides a useful alternative to the direct residual path, rather than a uniformly preferable replacement. **Revision.** Appendix A.4 gives the initialization, Heun updates, endpoint residual, and gate inputs. Appendix A.5 (Table A2) reports the four-setting comparison; Figure 3 and the main results tables identify the two paths separately.W1 — What the loss ablations and matched controls establish (3/3)
The original AVGC loss ablation provides complementary evidence about the contribution of velocity supervision. Table D1 reports 79.65% accuracy without , compared with 80.52% for the full model and 76.24% for unaugmented DARNet. Hence removing the velocity loss reduces accuracy by 0.87 percentage points, but the no-velocity residual model remains 3.41 points above DARNet. These results indicate that the residual augmentation mechanism and the remaining objectives also contribute substantially, with velocity supervision providing an additional improvement under the standard protocol.
To better isolate the velocity supervision, Table D3 additionally uses a fixed optimizer-step budget and common real-validation selection rule. Both rows below retain noisy targets, the same cross-attention residual network, other training objectives, Stage I classification of augmented features, and real-only Stage II adaptation:
| Matched-step setting (AVGC) | Accuracy | Macro-F1 | Precision | Recall |
|---|---|---|---|---|
| Velocity Off + Real-only | 78.63 ± 3.39 | 78.44 ± 3.38 | 79.26 ± 3.57 | 78.63 ± 3.39 |
| Velocity On + Real-only | 79.61 ± 2.97 | 79.39 ± 2.97 | 80.30 ± 3.11 | 79.61 ± 2.97 |
Enabling velocity supervision improves accuracy, macro-F1, precision, and recall by 0.98, 0.95, 1.04, and 0.98 points, respectively. Under this controlled protocol, the improvements support a representation-learning benefit from the velocity objective without adding generated samples during Stage II.
To address whether learned augmentations provide value beyond extra architecture and training, Table D4 compares two further matched-step, same-architecture settings with velocity supervision retained: classifying only real features in both stages (A: 78.35% accuracy) versus classifying real and augmented features in Stage I, followed by real-only Stage II (B: 79.61%). The 1.26-point gain supports a contribution from supervised generated features beyond identical architecture, noising, and training steps. Setting A still computes generated features for auxiliary losses, and it is a control for classification use of augmentation, not a generator-free model. The complete configuration reaches 80.52% under the standard schedule.
| Setting | Stage I classification | Stage II adaptation | Accuracy (%) | Macro-F1 (%) | Precision (%) | Recall (%) |
|---|---|---|---|---|---|---|
| A: Real-only classification | Real only | Real only | 78.35 ± 3.73 | 78.15 ± 3.81 | 79.06 ± 3.70 | 78.35 ± 3.73 |
| B: Augmentation in joint training | Real + Aug | Real only | 79.61 ± 2.97 | 79.39 ± 2.97 | 80.30 ± 3.11 | 79.61 ± 2.97 |
| C: CoMA-DiT | Real + Aug | Real + Aug | 80.52 ± 3.82 | 80.39 ± 3.82 | 81.00 ± 3.90 | 80.53 ± 3.80 |
Overall, the evidence supports two complementary roles: velocity matching improves the representation used by Single-Pass residual augmentation, while Reverse uses the learned field for explicit integration. This distinction clarifies the contribution of velocity supervision alongside the broader cross-modal augmentation mechanism.
Revision. Appendix D.1 (Table D1) now explicitly interprets the 79.65% ablation; Appendix D.3 (Table D3) specifies the matched velocity comparison and its budget; Appendix D.4 (Table D4) clarifies the same-architecture generated-feature classification control.
W1 — Clarifying velocity supervision and explicit integration (1/3)
Thank you for your careful review and for the opportunity to clarify our augmentation mechanism. We agree that learning a conditional velocity field and integrating that field for augmentation are distinct operations, and that a velocity-prediction loss alone should not be presented as evidence of a diffusion sampler. We have clarified that CoMA-DiT (Single-Pass) uses velocity supervision to guide cross-modal latent augmentation, and have additionally implemented CoMA-DiT (Reverse) to examine explicit conditional velocity integration.
Single-Pass: velocity-supervised latent augmentation. For target modality a conditioned on its paired source b, we construct a linear data-to-noise path and its velocity target:
\qquad \mathbf V^a=\boldsymbol\epsilon^a-\mathbf Z^a.$$ A conditional Transformer processes $(\mathbf Z^a_\tau,\mathbf Z^b,\tau)$ and produces hidden target tokens $\mathbf H$ and a velocity prediction. Two distinct heads use the shared representation: $$\hat{\mathbf V}=\phi_v(\mathbf H),\qquad \Delta_{\mathrm{SP}}=s\\,g\\,\tanh\\!\left(\phi_\Delta(\mathbf H)\right),\qquad \mathbf Z^{a+}=\mathbf Z^a+\Delta_{\mathrm{SP}}.$$ The squared-error velocity objective supervises the **shared Transformer representation and trainable encoders**, while a separate residual head produces the bounded augmentation. The two heads use the same learned tokens but serve different purposes: the velocity loss shapes the conditional representation during training, and classification, cross-modal consistency, and preservation objectives guide the residual for downstream decoding. In Single-Pass, the predicted velocity is **not numerically integrated**. We now describe this path as *velocity-supervised cross-modal latent augmentation*, distinguishing its single-pass generation from Reverse's integration-based construction. These clarifications make the two mechanisms more explicit: Single-Pass combines cross-modally conditioned residual augmentation with velocity-supervised representation learning, while Reverse examines how the learned conditional velocity field can also be used through numerical integration. **Revision.** Section 3.3 now makes the separate velocity/residual data flows explicit; Section 3.4 describes the loss as conditional velocity supervision. Figure 3 differentiates Single-Pass and Reverse, and Appendix A.4 describes the newly added integration-based path.