- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates how readout capacity, feature dimensionality, and low-level stimulus covariates affect multimodal gains in fMRI encoding. Using frozen features from three pretrained unimodal backbones, the authors compare several linear readout configurations and report that feature-width matching largely preserves fusion gains, whereas different readout restrictions can substantially change them.
Critical strengths
- Relevant research question. The paper examines how readout capacity and feature dimensionality influence measured multimodal gains in fMRI encoding, addressing an important methodological consideration in representation evaluation.
- Systematic empirical comparisons. The authors investigate multiple readout configurations, including ridge regression, random projection, and capacity-matched settings, while also considering the influence of low-level stimulus covariates.
- Reproducibility and experimental transparency. The paper provides extensive experimental details, additional control analyses, and replication experiments. The authors also explicitly acknowledge several limitations of their findings.
Critical weaknesses
- Limited novelty and insufficient experimental isolation. While the paper provides a systematic empirical analysis of readout-dependent fusion gains, its findings remain closely related to established knowledge about regularization, feature projection, and representation probing. The study does not provide sufficient mechanistic understanding of why different readout restrictions produce different fusion gains. In particular, the effects of subspace restriction and regularization geometry are not fully disentangled. The magnitude of the reported effects is also sensitive to the choice of unimodal baseline. Furthermore, the experiments involve only four subjects and primarily evaluate concatenated unimodal representations, leaving the generalizability of the findings insufficiently established. Overall, the paper does not convincingly demonstrate a substantial advance beyond existing knowledge.
- Poor presentation and insufficient methodological clarity. The overall presentation is unnecessarily verbose and poorly organized. The Related Work section is surprisingly brief and does not adequately establish the distinction between this work and closely related studies. Despite the complexity of the experimental setup, the Method section lacks a methodological overview figure and a clear, unified mathematical formulation of the different readout configurations. The main figures are small and difficult to interpret, while the text is dominated by dense numerical comparisons and extensive implementation details. Substantial space is also devoted to scope qualifications and reproducibility procedures without sufficiently clarifying the central scientific contribution. These presentation issues make the paper difficult to follow and weaken the communication of its contribution.
Questions for authors
None.
Dear Reviewer dn4t,
Can you please take a look at the authors' response and provide your further input? Thank you.
AC.