- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SI-HGN to extend neural perturbational inference using structural-connectivity-guided propagation and learned hypergraph context.
Critical strengths
- Incorporating anatomical information into perturbation-based surrogate models is a useful direction for effective-connectivity inference.
- The paper includes recurrent simulations, a whole-brain model, macaque-derived simulations, and human MTL data.
Critical weaknesses
- Although graph propagation respects SC support, unrestricted hypergraph aggregation and the global prediction head permit influences outside that support. Quantify these contributions before attributing improved EC recovery to anatomically grounded pathways.
- Clinical gains are weak relative to simple baselines. ABIDE accuracy is 57.5% versus a 55% majority-class baseline; AD-versus-MCI accuracy is 63.87% versus approximately 61.3%. Include FC-only, SC-only, and combined FC–SC classifiers with uncertainty under the same nested evaluation.
Questions for authors
How are temporal train/test partitions constructed, and are overlapping windows separated across partitions?
3 comments
Thank you for the clarification, but my main concerns remain unresolved. The response does not address the potential contribution of unrestricted hypergraph aggregation and the global prediction head to influences outside SC support. Please provide targeted ablations or quantitative analyses distinguishing the contributions of these pathways from SC-constrained propagation before attributing improved EC recovery to anatomically grounded pathways.
Response to Reviewer Sy47
Q1: Please provide targeted ablations or quantitative analyses distinguishing the contributions of these pathways from SC-constrained propagation before attributing improved EC recovery to anatomically grounded pathways.
Response to Q1: We thank the reviewer for this helpful comment. We quantified the performance degradation caused by removing each component, based on the EC Pearson correlations reported in Table 7. For each dataset, we assessed the relative contributions of the three components based on their respective ablation results, as summarized in Table 1, providing an estimate of their contributions to overall EC recovery. To avoid potential bias arising from the shared network support between the structural scaffold and the binary reference EC in the Macaque benchmark, we report the equally weighted average across the remaining three benchmarks (WBM, MTL-L, and MTL-R).
The resulting normalized ablation-based contribution estimates are 40.44% for SC, 26.61% for hypergraph aggregation, and 32.95% for the global prediction head. These results demonstrate that SC plays an important role in EC recovery, representing the largest individual contribution among the three components and highlighting the importance of incorporating anatomical structural priors into EC modeling. Meanwhile, hypergraph aggregation and the global prediction head collectively account for the remaining 59.56%, indicating that higher-order contextual modeling and global information integration also provide substantial complementary benefits. Overall, these findings support the complementary roles of anatomically informed structural propagation and additional information-integration mechanisms in EC recovery.
Table 1. Normalized ablation-based contribution estimates of the three components across three benchmarks (%).
| Dataset | SC | Hypergraph aggregation | Global prediction head |
|---|---|---|---|
| WBM | 27.18 | 25.50 | 47.32 |
| MTL-L | 43.54 | 28.12 | 28.34 |
| MTL-R | 50.61 | 26.21 | 23.18 |
| Average | 40.44 | 26.61 | 32.95 |
Response to Reviewer Sy47
Dear Reviewer Sy47:
Response to Q1. Thank you for this careful question about temporal partitioning and the handling of overlapping windows near the partition boundary.
Partition construction. We follow the default temporal partitioning procedure of the public NPI implementation. Sliding windows are first constructed from the time series (three consecutive frames predicting the next), and the windows are then split chronologically. The first 80% of windows are used for model training, and the remaining 20% for validation and early stopping. Random shuffling is applied only within the training set, never across the temporal boundary. SI-HGN and the NPI baseline use exactly the same windows and the same partitioning procedure, so the comparison is not affected by any asymmetry in data handling.
Overlapping windows at the boundary. Consistent with the public NPI code and its original experimental settings, we do not additionally separate or remove windows that overlap across the partition boundary; adjacent windows at the training–validation boundary therefore still share two input frames. We expect the impact of this choice to be limited, for three reasons. First, the main evaluation target is EC recovery by the trained surrogate (the correlation between the inferred and reference EC matrices), not predictive generalization to a strictly held-out temporal segment; boundary leakage would compromise the latter, not the former. Second, because both methods are trained and evaluated under an identical protocol, any residual effect of boundary overlap is shared symmetrically and cannot account for the performance differences we report. Third, the reference EC on the simulation benchmarks is defined by the generative model rather than by the validation split, which decouples EC recovery accuracy from temporal generalization.
Clarification added to the manuscript. Following your suggestion, we have added a detailed description of temporal window construction, data partitioning, and the treatment of overlapping windows to Appendix A.1.8 (page 22, line 1134), so that the protocol and its scope are fully transparent and reproducible.
Thank you again for your careful review and constructive suggestions, which have helped improve the transparency of our experimental description.
Weakness
Response. Thank you for raising this issue. We agree that the classification improvements over the majority-class baseline are limited, and we have revised the manuscript to prevent over-interpretation. The clinical analysis is intended as an exploratory probe of whether model-inferred EC contains disease-related information, not as a clinical diagnostic validation, and we do not claim diagnostic utility. As now stated explicitly in “Limitations and outlook” in the Conclusion (page 10, line 515), the absence of subject-level ground-truth EC, the small cohorts, and the lack of external replication bound the clinical interpretation of the current results; the reported disease-related patterns should be regarded as exploratory, model-derived network hypotheses rather than established biomarkers, and the modest classification gains (e.g., 60.0% vs. 56.6% accuracy in AD vs. CN) are directionally consistent across tasks but hypothesis-generating in nature. In future work, we will evaluate the clinical potential of individualized EC through larger multicenter cohorts, independent external validation, and prospective clinical studies.