- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper investigates whether preserving temporal connectivity information can be more valuable than increasing model capacity on static FC. TempLasso selects discriminative connections using ℓ1-regularized logistic regression and models their sliding-window trajectories with a BiGRU. It can also augment existing static backbones through fusion. Experiments cover three cohorts and five backbones, with additional temporal-order and windowing controls.
Critical strengths
-
The paper asks a clear and relevant question; whether static aggregation limits FC modeling more than architectural capacity. TempLasso provides a simple temporal branch that can augment different static backbones. The writing and introductory primer make the work accessible to an ML audience.
-
The training and model-selection protocol includes useful safeguards. Models use identical subject splits, normalization and edge selection are fitted on training subjects only, and configurations are selected using validation data. Per-combination paired tests are reported, including non-significant results.
-
The experiments include informative controls beyond the main static comparison; full-backbone temporalization, shuffled-order and order-invariant aggregators, and window-length sensitivity. Positive mean fusion gains across all 15 backbone–dataset combinations provide encouraging empirical evidence.
Critical weaknesses
-
The source of the temporal benefit remains insufficiently isolated. Although the order-invariant MLP control is useful, a static classifier on the same selected edges and simple window-summary baselines are missing. The experiments also do not establish whether the gains require time-varying coupling or can be explained by stationary temporal statistics, sampling variability, or acquisition-related effects.
-
The fusion results do not isolate temporal complementarity from general ensemble benefits. Prediction-level fusion averages independently trained static and temporal models, but no matched static–static fusion control is provided. Reporting positive gains in all 15 combinations therefore supports augmentation empirically without establishing how much benefit specifically requires temporal inputs.
-
The “representation over capacity” interpretation is not cleanly isolated. TempLasso and TempX differ in supervised edge selection, input dimensionality, and architecture, alongside capacity. Selected-edge counts and parameter counts are not reported, and edge selection itself is not ablated. These omissions make it difficult to distinguish the benefits of temporal access, sparsity, and model size.
-
Statistical support remains limited by dependence and small cohorts. The aggregate tests treat 15 combinations sharing cohorts and splits as independent, while PPMI test splits contain approximately three participants from each minority class. Reporting inconsistencies also require clarification, particularly standalone PPMI performance in Table 2 versus Tables 8–10 and the GRU performance gap stated in Appendix C.3.
Questions for authors
-
Please compare against a static logistic/MLP classifier on the same selected connections, using matched FC preprocessing, and a simple classifier on per-edge mean/SD of windowed FC. Together with the existing order-invariant MLP, these would help isolate which information accounts for the gains.
-
How does X+TempLasso compare with X fused with another static predictor under the same validation and fusion protocol? Please also report which fusion strategy, embedding concatenation or probability averaging, was selected for each split and backbone–dataset combination.
-
Please ablate supervised edge selection using random edges matched in number and, where feasible, all 4,950 edges with the same temporal aggregator. Report selected-edge counts across splits and trainable parameter counts, so that the sparsity and low-capacity claims can be assessed separately.
-
How is the shuffled-window permutation generated: independently per subject, per epoch, or fixed? Since shuffling overlapping windows also disrupts local smoothness, a matched stationary-surrogate experiment preserving static covariance and ROI power spectra, with corresponding model retraining and evaluation, would help clarify whether changing coupling is necessary for the observed benefit.
-
Please provide dependence-aware uncertainty estimates for the aggregate gains and clarify the stability of model selection with very small clinical validation sets. Also reconcile PPMI TempLasso performance of 62.12±8.30 in Table 2 versus 62.98±7.42 in Table 8, and the reported GRU gap of 2.18 versus 1.49.
Dear Reviewer JMgz,
As the discussion period closes tomorrow, we wanted to check whether our responses and the revised paper address your concerns, and we would be glad to clarify anything before the deadline. Thank you again for your time and constructive review.
Authors