- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper uses multiple frozen source subject decoding paths for the fMRI input of the same target subject, uses the average representation of the path output to constrain target adaptation, and combines reliability weighting, feature perturbation and category constraints to improve cross-subject visual decoding under one hour of target data conditions.
Critical strengths
-
Source model constraints are introduced during training, and additional branches can be removed during inference.
-
Compared to MindTuner, which replicates the same protocol, some reconstruction metrics show actual improvements. In Appendix Table 6, AlexNet-2, AlexNet-5, Inception, and CLIP show improvements of approximately 1.63, 1.42, 1.82, and 2.24 percentage points, respectively.
-
Component ablation, parameter sensitivity, and baseline reproduction are provided. These experiments form the basis for further evaluation of the method's contribution.
Critical weaknesses
-
The paper interprets "output consistency across different model paths" as "shared semantics across subjects," but these two concepts are not distinguished experimentally. Section 3.3 explicitly states that the Source Bank does not aggregate the actual brain responses of the same stimulus to different subjects, but rather zeros-padding or truncating the input of the same target subject before sending it to the projection layers of different source subjects. The authors also acknowledge that this step does not establish anatomical or functional correspondences between voxels. Therefore, the so-called source subject differences may be a mixture of pre-training parameter differences, voxel index mismatches, and common network biases, and cannot be directly interpreted as natural inter-subject neural variations. Figure 2 shows that the cosine similarity between the target representation and the source mean is higher than its similarity with a single source representation, supporting the interpretation of "extracting shared semantics." For example, the correlation value increases from 0.568 to 0.729. However, vector averaging itself may eliminate components in different directions, highlight common directions, and increase cosine similarity; common directions may also come from shared backbones or representational anisotropy, rather than correct stimulus semantics. What is currently established is that multi-path representations have geometric commonalities, but what is not yet established is that this commonality corresponds to transferable visual semantics.
-
The mathematical implementation of “expanding feature coverage using source divergence” is essentially radial scaling. Equation 8-11 first compresses the cross-source variance into a scalar, then performs the following operation:
.
This operation preserves the direction of the target residual, only adjusting its length. It does not use the directional structure of the cross-source covariance, nor does it sample along the actual source difference direction; when , it even exhibits contraction towards the source center. Therefore, “expanding the distribution along a reasonable cross-subject variation” is not a property naturally derived from the formula; ordinary norm perturbations or contraction regularization could also explain the benefit. Ablation by removing SDA cannot replace comparisons with these simple enhancements. The authors need to provide the value distribution, truncation rules, and realization boundaries, and cannot simply use the name “reliability calibration” to replace mathematical guarantees.
-
In Table 3, Subject 2's baseline after disabling the new components reached a brain retrieval rate of 91.00%, while MindEye2 in Table 1 only achieved 67.18%. The complete MindBank sample reached 92.37%, only a 1.37 percentage point increase compared to a truly close fit baseline; image retrieval, however, decreased from 95.12% to 92.47%. Component results also did not consistently support the complete combination. After removing RC, brain retrieval was 92.49%, slightly higher than the complete model; after removing SDA, it was 92.42%; after removing CSA, image retrieval reached 94.62%, higher than the complete model. Current ablation methods mainly involve item-by-item deletion of the complete model, lacking controls for Source Bank alone, CSA alone, single-teacher constraints, and ordinary perturbations, and are primarily focused on Subject 2.
-
Existing evidence is insufficient to support a strong ranking conclusion. The comparison criteria between the main text and the appendix are questionable. The main text emphasizes a 5.69 percentage point improvement in brain retrieval compared to MindTuner, but the same protocol reproduction in Appendix Table 6 improves MindTuner brain retrieval to 80.50%, at which point MindBank's advantage is only 1.14 percentage points, and the image retrieval gap is even smaller at only 0.03 percentage points. Fair reproduction is commendable, but conclusions should be organized around these results.
-
Appendix A.4 sets for subjects 1 and 2 and 0.30 for subjects 5 and 7 based on the similarity between different target subjects and the source mean; Appendix C.1 cites corresponding similarity values to support these choices. Meanwhile, C.4 states that the similarity analysis comes from brain responses corresponding to 1,000 independent retained images. The paper does not explicitly state whether these retained samples are the final test set in the main table. If so, the parameter selection at least utilizes the overall statistics of the test input, and its transitive setting needs to be explicitly stated; if the test reconstruction score is also referenced when selecting "balanced" parameters, the issue further involves the participation of test indicators in model selection. The existing text cannot prove that improper parameter tuning occurred, but it cannot be ruled out either.
-
The category accuracy in Figure 1 improved from 20.3% for MindEye2 to 26.0%, but the strongest comparison object, Duala, reached 25.5%. The paper does not fully explain the category vocabulary, classifier, ground truth definition, and how multi-object images are mapped to single labels. CSA relies on "CLIP-assigned categories," and if the training pseudo-labels are highly coupled with the evaluator, an increase in category scores does not necessarily mean improved independent semantic correctness. "Data efficiency" is also only validated on one target session, lacking data volume curves and source participant number curves. The training parameters 68.45M are only about 0.93% less than Duala's 69.09M.
Questions for authors
-
Can the source mean itself correctly retrieve the corresponding image? After removing the global mean, mismatched stimuli, or shuffling voxels, do the similarity advantage and final performance of Figure 2 still exist? Can multiple sub-teachers for the same subject achieve similar gains?
-
Is SDA superior to ordinary radial scaling, Gaussian perturbation, and Mixup of the same intensity? What are the actual minimum and maximum values of the reliability weights and ?
-
Why is the fully closed baseline in Table 3 significantly stronger than MindEye2 in Table 1? After fixing the low-rank adaptation, training budget, and number of parameters, how much independent gain do Source Bank and CSA each provide?
-
Why doesn't the main text use the MindTuner protocol reproduced in the appendix as the primary comparison?
-
Did the 1,000 hold-out samples used for similarity analysis participate in the final test? When and on which validation set were all parameters determined?
-
How is class accuracy defined, and is an evaluator independent of the training pseudo-labels used? How much actual training time and GPU memory can the method save under different target data volumes and source subject numbers?