- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper asks a simple question. When a side signal such as brain activity is fed into a language model and the output changes, is that change useful, or is the model only being perturbed? The authors propose a paired-control rule. Matched brain input (REAL) must give lower target NLL than both a removal control (ZERO) and a mismatch control (SHUF). They also separate “deformation”, measured by JSD from the ZERO distribution, from “utility”, measured by target NLL. The protocol is released as a toolkit called PairedControlBench, together with a five-item reporting standard.
Critical strengths
The MEG experiments are careful. I appreciate the range of mismatch controls, including within-subject, within-sound, local-time, circular shift, block permutation and phase randomization. The Gaussian null streams and the BERT positive control are good sanity checks on the pathway itself.
Critical weaknesses
My first concern is the novelty of the protocol itself. Removal and permutation controls are already standard in multimodal analysis. NeurIPS 2021, “Perceptual Score” measures how much a model uses a modality by permuting it across samples, which is essentially SHUF. EMNLP 2020, EMAP tests whether models really use cross-modal interactions. In neural encoding and decoding, permutation tests over mismatched segments are also routine. The paper does not discuss this line of work. I think the contribution is better framed as bringing a known two-control logic into brain-conditioned LMs and making it strict, rather than as a new principle.
My second concern is that ZERO is not a neutral control. A model trained only on nonzero brain input has never seen an all-zero input. Its behavior at zero may be arbitrary. This matters for how the results are read. At 544-D, SHUF beats ZERO, and the paper calls this a regularizer effect. A simpler reading is that ZERO is off-distribution and so a weak baseline.
Questions for authors
Were any of the models trained with brain-input dropout or zeroing, so that ZERO is in-distribution? If not, how do you rule out that the REAL vs ZERO gap partly reflects off-distribution behavior at zero? Do you have a text-only baseline with matched trainable capacity?