- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes BrainTAL, a target-adaptive framework for cross-site brain network analysis under source-free and label-free adaptation settings. The method introduces compact brain network instructions, task-conditioned brain tokens, and an adaptive calibration strategy to address distribution shifts across imaging sites. Task-specific queries are used to extract representations for different prediction objectives, while a lightweight adapter is updated using unlabeled target-site data. Experiments on ABIDE and ADHD evaluate the framework on disease classification, sex classification, and age prediction.
Critical strengths
-
The paper addresses a relevant problem in multi-site neuroimaging, where distribution shifts and restrictions on source data availability make model adaptation challenging. The proposed setting is practically motivated.
-
The task-conditioned brain token mechanism provides a reasonable approach to modeling different prediction objectives using shared functional connectivity representations. The integration of task conditioning and source-free adaptation is potentially useful.
-
The experiments cover multiple prediction tasks on two neuroimaging benchmarks. The results in Tables 1 and 2 show improvements over several competing approaches, and the ablation experiments provide additional evidence for the proposed components.
Critical weaknesses
-
The methodological novelty is somewhat limited. Task-conditioned representation learning, lightweight adaptation, and consistency-based optimization have been explored extensively in related areas. Although their integration is reasonable, the paper does not sufficiently establish which aspect represents a substantial methodological advance beyond existing approaches.
-
The justification for incorporating a large language model is not entirely convincing. The prediction tasks mainly involve structured functional connectivity information, and it remains unclear whether language-based semantic representations provide advantages that cannot be achieved using a smaller task-conditioned graph model. A more controlled comparison with non-LLM alternatives would strengthen the contribution.
-
The target adaptation strategy relies on confidence-guided consistency learning. Such approaches can be sensitive to inaccurate predictions and distribution shifts. The paper would benefit from a more detailed investigation of adaptation stability, particularly when the initial source model performs poorly on the target site.
Questions for authors
-
How much of the performance improvement comes specifically from language-guided modeling rather than task-conditioned graph representation learning? Could the authors provide a comparison with a similarly sized non-LLM architecture?
-
How sensitive is the proposed calibration strategy to the confidence threshold and the quality of initial target predictions?
-
Does the method remain effective when the target site has substantially different demographic or disease distributions from the source sites?
3 comments
Thank you for the additional comparisons and site-wise analyses. These help address my concerns, but the gains over ViT-3B do not clearly isolate the benefit of language-guided modeling. The decline with prolonged adaptation also leaves questions about stability. Together with my remaining concerns about methodological novelty, I maintain my rating of 2
Dear Reviewer,
Thank you for taking the time to review our additional comparisons and site-wise analyses. We appreciate your acknowledgement that these results help address some of your concerns.
Regarding the LLM contribution, we agree that the ViT-3B comparison evaluates the overall designs and does not by itself isolate the effect of language semantics. We added it to assess BrainTAL against a non-LLM alternative of similar parameter scale. In addition, the matched adaptation comparison in Table 4 uses the same source checkpoint and adapter architecture, allowing us to examine the contribution of the adaptation strategy under a shared source-model setting.
Regarding stability, the main results use a fixed 10-epoch adaptation schedule, with neither target labels nor target-label-based model selection. The site-wise analysis in Appendix A.5 shows improvements at NYU, where the initial source-only accuracy is lowest in both datasets. The longer adaptation trajectory is included to show how performance changes when adaptation is extended.
We have also clarified that the methodological contribution lies in coupling task-conditioned brain tokens with source-free calibration at the brain–language interface, with the diagnosis-calibrated adapter shared across tasks. We hope these clarifications help convey the motivation and contribution of the overall framework.
We would be grateful if you could consider whether the additional evidence and clarifications warrant revisiting your assessment. Thank you again for your time and careful consideration.
Response to Reviewer DHxa
Dear Reviewer,
We sincerely thank you for your thoughtful and constructive review. We appreciate your recognition of the practical relevance of cross-site brain network analysis and the potential of combining task conditioning with source-free adaptation. Your comments helped us clarify the methodological contribution and strengthen our evaluation. We have revised the manuscript and respond to your concerns below.
Weakness 1: Methodological contribution
We have clarified the contribution of BrainTAL in the Introduction. BrainTAL couples task-conditioned graph-to-token mapping with source-free calibration at the brain–language interface. Shared queries and task-specific offsets produce task-dependent brain tokens, while a lightweight adapter is calibrated using unlabeled target-site diagnosis predictions and then shared across tasks. This design addresses cross-site shifts at the interface between brain representations and the language model.
The ablation in Table 3 shows that removing task-conditioned tokenization reduces diagnosis accuracy by 4.93 and 6.68 percentage points on ABIDE and ADHD, respectively. Under the matched adaptation setting in Table 4, BrainTAL Stage II exceeds the teacher–student baseline by 1.73 and 2.48 percentage points, respectively.
Weakness 2 and Question 1: Comparison with non-LLM alternatives
To examine the LLM-based design, we added comparisons with two non-LLM alternatives: a task-conditioned graph model with a compact prediction head and one with a ViT-3B module. The ViT-3B model has 3.028B parameters, compared with 3.141B for BrainTAL. All models are evaluated under the same data splits, and Stage II uses unlabeled target-site data.
At Stage I, the compact-head model achieves 61.44% and 56.93% diagnosis accuracy on ABIDE and ADHD, while the ViT-3B model achieves 62.11% and 57.64%. BrainTAL-S1 achieves 63.93% and 58.81%, respectively. After Stage II adaptation, the corresponding accuracies are 64.46% and 58.92% for the compact-head model, 66.14% and 60.96% for the ViT-3B model, and 66.65% and 62.81% for BrainTAL.
Against the similarly sized ViT-3B model, BrainTAL improves accuracy by 1.82 and 1.17 percentage points at Stage I, and by 0.51 and 1.85 percentage points after Stage II, on ABIDE and ADHD, respectively. These comparisons are reported in Table 6, Appendix A.4, and support the benefit of the overall LLM-based design relative to the tested alternatives.
Weakness 3 and Question 2: Adaptation stability and confidence criterion
We have clarified the confidence criterion in Section 3.3.2. BrainTAL assigns sample weights based on teacher prediction entropy and normalizes them within each mini-batch. The value 0.1 is used to determine whether to update the batch; it is not a sample-level probability cutoff. Because the maximum normalized weight is typically close to one in a non-degenerate batch, this criterion generally permits the update.
To examine adaptation when the initial source model performs relatively poorly, we provide site-wise results in Appendix A.5. On NYU, the site with the lowest source-only diagnosis accuracy in both datasets, accuracy increases from 58.33% to 63.33% on ABIDE and from 52.92% to 56.10% on ADHD after adaptation. Figure 3(a) also shows that performance improves during the first 10 adaptation epochs but declines with prolonged adaptation. These results illustrate adaptation behavior at sites with relatively low initial accuracy.
Question 3: Demographic and disease distributions
We have added a site-wise analysis of the observed distributions in Appendix A.5. For ABIDE-USM, the male proportion is 100.00% at the target site versus 81.95% in the pooled source sites, while the diagnosis-positive proportion is 61.67% versus 44.15%. Diagnosis accuracy increases from 68.33% to 70.00% after adaptation.
For ADHD-KKI, the diagnosis-positive proportion is 26.60% at the target site versus 47.67% in the pooled source sites, and accuracy increases from 65.96% to 68.49%. Target labels are used for post-hoc reporting, not adaptation or model selection. These examples show improvements under the observed site-level distribution differences.