- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes SCRYER, a neural population forecasting framework that combines multiscale temporal decomposition, neuron-level attention, and retrieval-conditioned candidate forecast selection.
- Method: Each neuron's history is decomposed into multiple temporal-frequency components to generate candidate forecasts. Population context, obtained through attention over neuron identity and activity embeddings, is used to weight these candidates and produce an additive correction.
- Experiments: The authors evaluate SCRYER on IBL electrophysiology and calcium-imaging datasets from mice, C. elegans, and zebrafish, reporting consistent forecasting improvements over existing baselines.
- Biological analysis: The authors demonstrate brain-region decoding from learned embeddings and investigate neurons' relative dependence on individual history versus population activity.
Critical strengths
1. Broad experimental evaluation with consistent improvements.
The paper evaluates SCRYER across multiple species, recording modalities, and established baselines. The model consistently achieves competitive or superior forecasting performance.
2. Potential biological insights from forecasting representations.
The analysis of history-driven and population-driven neurons provides a potentially interesting perspective on neural population dynamics.
Critical weaknesses
The main weaknesses are stated below, and the authors can check the Questions For Authors part for the details.
1. Incremental performance and insufficient validation of the key contributions.
The proposed architecture combines established techniques, including temporal decomposition, neuron identity embeddings, self-attention, and weighted forecast aggregation. Similar neuron-level attention mechanisms have already been explored in previous work, such as NetFormer.
The forecasting improvements over the strongest baselines are relatively modest, generally around 1–5%.
More importantly, the central contribution of retrieval-conditioned candidate selection is not directly validated. The current ablations do not sufficiently isolate the contributions of candidate generation, population-conditioned selection, and the additive correction network.
2. Limited novel biological insights and insufficient controls.
- Figure 3: Brain-region decoding has been extensively investigated in previous work and is not a novel task. More importantly, the simple ISI-based baseline reported in BrainWideBench (Table 3) achieves better brain-region classification performance than SCRYER. Although the evaluation settings are not identical, this raises questions about whether deep forecasting representations provide additional biological information beyond conventional spike-train statistics.
- Figure 5: The history-driven versus population-driven analysis is potentially interesting, but similar masking experiments could be performed using existing forecasting models, such as POCO. The masking procedures are not symmetric and may introduce distribution shifts. Furthermore, the reported dependence on history versus population correlates with firing statistics, making it unclear whether the observed patterns reflect biological properties or model-specific effects.
Overall, the experiments do not sufficiently demonstrate novel biological discoveries uniquely enabled by SCRYER.
3. Insufficient evidence supporting the scalability claim.
Scalability is emphasized in the title, yet the paper provides limited evidence of meaningful scaling behavior across data, model capacity, and computational resources.
- Data scaling: Figure A2 shows that increasing the Allen training data from 200 to 1,334 sessions (6.7×) reduces MSE by only 0.003 (0.32%). Although statistically significant, this improvement is practically marginal. Figure 4 shows more substantial gains on IBL, but comparisons with the scaling behavior of existing methods are missing.
- Model scaling: The paper does not investigate whether increasing model capacity leads to further performance improvements.
- Computational scalability: There is no systematic evaluation of training/inference time or memory consumption as neuronal population size increases. This is particularly relevant because neuron-level attention has quadratic complexity in the number of neurons.
Furthermore, the zebrafish experiments operate on 512 PCA components rather than the original individual-neuron recordings. While this follows the existing POCO benchmark protocol, it does not directly establish scalability of neuron-level retrieval to large neuronal populations.
Overall, the current evidence is insufficient to convincingly substantiate the scalability claim in the title.
Questions for authors
Major Questions
Q1. Contribution of candidate generation and selection.
Could the authors provide additional ablations to isolate the contributions of candidate generation and selection in Figure 1(d)?
Specifically:
- Correction-only: Directly predict using the existing correction MLP (), without the candidate branch.
- Single MLP: Replace the multiple candidate forecasting heads with a single MLP using the same temporal features, while retaining the correction network.
- Uniform selection: Retain the candidate forecasts and correction network, but use uniform weights instead of population-conditioned weights.
- Energy-based selection: Retain the candidate forecasts and correction network, but use only the existing energy-based SE weights, without population-conditioned selection.
These comparisons would clarify whether the proposed candidate generation and population-conditioned selection mechanisms independently contribute to forecasting performance.
Q2. Contribution and interpretation of neuron-level retrieval.
Could the authors provide population-level analyses of the learned attention patterns, including:
- Self-attention weights and attention entropy across neurons.
- Whether different target neurons attend to different source neurons.
- The relationship between attention weights and neuronal activity correlations.
These analyses would provide stronger evidence of what the proposed neuron-level retrieval mechanism actually learns, beyond the illustrative examples in Figures 2 and A5.
Q3. Novel biological insights beyond brain-region decoding.
Brain-region decoding has already been extensively studied, and the ISI-based baseline in BrainWideBench Table 3 achieves better classification performance than SCRYER under its reported evaluation setting.
Beyond brain-region classification, could the authors demonstrate biological findings that are uniquely enabled by SCRYER or are substantially stronger than those obtainable using existing methods?
Such results would help establish the biological significance of the proposed approach beyond incremental improvements on an established decoding task.
Q4. Robustness and model dependence of Figure 5.
Could the authors perform similar history-only and population-only analyses using existing forecasting models, particularly POCO?
Additionally, could the authors investigate whether the conclusions remain consistent under alternative masking strategies that reduce distribution shift, and clarify how neurons with near-zero full-model predictive performance are handled?
These analyses would help determine whether the reported history-driven and population-driven patterns are robust neural properties or model-dependent observations.
Q5. Scalability and computational efficiency.
Given the emphasis on scalability in the title, could the authors provide systematic scaling experiments that evaluate:
- Forecasting performance as the number of training sessions or recorded neurons increases.
- Training/inference time, GPU memory consumption, and model parameter counts.
- Comparisons with existing methods, particularly POCO, under comparable computational budgets.
In particular, POCO has already evaluated forecasting at single-cell resolution on the original zebrafish recordings, whereas SCRYER only reports experiments using 512 PCA components. Could the authors clarify whether SCRYER can achieve comparable population-level scalability without PCA-based dimensionality reduction?
Minor Question
1. Figure 3: Interpretation of the LDA visualization.
The LDA projection uses brain-region labels to construct the discriminant axes. However, the held-out neurons in Figure 3(b) do not appear to exhibit clear anatomical separation, despite being projected onto the same axes as Figure 3(a).
The authors should clarify how strongly this visualization supports cross-animal anatomical generalization, rather than relying primarily on qualitative clustering.
2. Line 49: Unclear description of previous methods.
The statement "mixing of neurons early before training" is inaccurate or at least misleading.
In POCO, neuronal information is aggregated through a learned encoder during the forward pass, rather than being mixed before training. The authors should clarify this statement and more precisely distinguish SCRYER's retrieval mechanism from previous population-conditioned forecasting architectures.
3. Related work and additional baselines.
Recent related work for neural forecasting, including OmniMouse (ICLR2026) and CalM (ICML2026), is not discussed. Could the authors clarify how SCRYER differs from these approaches and consider additional forecasting comparisons where datasets and evaluation protocols can be matched?
4. Calcium forecasting metrics and preprocessing.
The calcium-imaging results are evaluated mainly using MSE and MAE. Could the authors also report per-neuron Pearson correlation to assess the prediction of temporal activity fluctuations? Moreover, calcium traces are z-scored using statistics from the full recording before temporal train/validation/test splitting. Could the authors clarify the implications of using information from held-out periods, and ideally report results with normalization fitted on training data only?
5. Reproducibility.
Appendix C.2 reports the POCO architecture used for electrophysiology but does not clearly specify how its output parameterization and training objective were adapted to spike counts. Does POCO use the same log-rate output and Poisson loss as SCRYER? Could the authors complete run configurations for SCRYER to support reproducibility?
The reviewer would update the score if reasonable answers are provided.
9 comments
2. Novel biological insights beyond brain-region decoding (Q3, W1)
2.1. "Could the authors demonstrate biological findings that are uniquely enabled by SCRYER or substantially stronger than those obtainable with existing methods?"
Thank you for raising this point. While brain region decoding has been investigated in prior works, we want to clarify that the main goal of that set of experiments is to show that our model has learned a meaningful representation of the anatomy using its forecasting loss alone. In contrast, the methods in the Inductive task setting in Brainwidebench have been trained and extensively tuned for the problem of brain region decoding, so it is an inherently different problem setting. Under the same setting as ours, POCO and MtM learn significantly less information about the brain region from their forecasting and masking losses, respectively.
Additionally, due to SCRYER’s ability to directly query information from individual neurons in the population (i.e., neuron-to-neuron attention), we can quantify predictive information that comes from a source neuron to forecast a target neuron’s future activity. This produces a graph which encodes the neuron-to-neuron attention that depends on the neuron identity and activity of the neurons in the context window. Building such graphs to study functional connectivity is an outstanding problem in neuroscience and we believe that SCRYER provides a step in this direction.
We note that this neuron-to-neuron attention analysis is not possible with models like POCO and OmniMouse, where the population state is compressed into a set of latent tokens and thus the queries are across the entire population rather than individual neurons.
Validation against the mesoscale connectome. We first tested how the learned attention maps in SCRYER align with the known anatomical connectome. We computed the target-specific attention between brain regions (each source's attention normalized by the mean attention it receives from all targets, which removes the component shared by all targets) and compared it with the mesoscale connectome of the Allen Mouse Brain Connectivity Atlas, an independent measurement of axonal projections made by viral tracing across a large cohort of mice (Oh et al., 2014, Knox et al., 2019). In our analysis, region pairs that are more densely connected attend to each other more (Spearman 0.47 over 2,104 region pairs, permutation p < 0.001), and the agreement remains after controlling for distance, shared probes, parent region and firing rate (0.28). As a baseline we computed jitter-corrected cross-correlograms (CCG, Siegle et al., 2021), the standard spike-timing estimate of connectivity, on the same recordings and the same region pairs. After the same controls, SCRYER's learned attention agrees with the connectome better than CCG at the fine level (0.28 against 0.22) and at the coarse level of ten major brain divisions (0.47 against 0.23, where CCG is not significant). Neither method recovers the direction of projections, so the agreement concerns how strongly regions are connected rather than which way they project.
Studying state-dependent maps of predictive information. Next, we analyzed the state-dependent properties of the attention across neurons and whether the attention patterns could be used to differentiate rewarded or non-rewarded states. We compared attention in the second after reward with the second after an error (no reward). We used the 29 evaluation recordings from 13 mice never seen in pretraining, each with its finetuned model, and analyzed only time the model never trained on. If attention were a fixed map, it would not change between the two states. Instead, attention between regions separates them in 97% of recordings, and in 90% after regressing out firing rates, compared with 48% for activity correlation. The change is dense rather than confined to a reward network. About 80% of neurons switch their most-attended sources, in every major region (50–98% per region), and the neurons that switch fire faster and change their rate more between the two states. The largest increases after reward are in attention to thalamic and midbrain sources, and the reward-minus-error pattern is shared across mice (r 0.33, p = 0.02). The 423 pretraining recordings from 126 mice show the same pattern on held-out time (79% of recordings, against 22% for activity correlation).
2.2. "Do deep forecasting representations provide additional biological information beyond conventional spike-train statistics?"
To address this question, we evaluated the advantage of SCRYER's representation over spike-train statistics (inter-spike interval, ISI, histograms). To isolate what SCRYER's architecture adds, we initialized the embeddings of held-out neurons from ISI-based spike-train fingerprints, finetuned them with SCRYER (embeddings only, network frozen), and decoded brain region from the result with the same linear probe used for the ISI features, so the two scores differ only by what SCRYER adds on top of the ISI information. With this initialization, region decoding improved for every pretrained model, and the mean single-unit macro-F1 rose from 0.240 to 0.273, above ISI alone (0.262). The gap is even larger at the finer level of 44 Beryl regions (0.335 vs. 0.244 for ISI, chance 0.075). SCRYER's representation therefore carries more region information than spike-train statistics, suggesting that SCRYER learns additional biological information beyond firing statistics.
3. Robustness and model dependence of Figure 5 (Q4)
3.1. "Could the authors perform similar history-only and population-only analyses using existing forecasting models, particularly POCO?"
To address this question, we applied the same masking to POCO. This analysis measures how much each neuron depends on the population, not which neurons it uses, so any model that forecasts each neuron can be tested. The two models agree on which neurons and regions depend most on the population (Spearman 0.51 across neurons and 0.66 across regions). POCO, however, uses the population less effectively. From the population alone, SCRYER predicts a neuron twice as accurately (median D2 0.073 vs 0.032), because each target draws on individual neurons rather than on one compressed summary.
3.2. "Could the authors investigate whether the conclusions remain consistent under alternative masking strategies that reduce distribution shift?"
To show that the map does not depend on the masking scheme, we replaced the mean with an in-distribution mask, in which the masked input is the same neuron's activity from another random test window, so the model sees only real activity. The ranking of neurons remains nearly unchanged (Spearman with the original Δ 0.85 for SCRYER and 0.90 for POCO), and the two models still agree (0.44 across neurons and 0.80 across regions, against 0.51 and 0.66 with the mean).
3.3. "Could the authors clarify how neurons with near-zero full-model predictive performance are handled?"
To show that excluding poorly predicted neurons does not shape the attention map, we varied the exclusion threshold. Δ is divided by the full-model D2 and is unstable near zero, so we exclude neurons with full-model D2 ≤ 0.05 (657 of 3,196 for SCRYER) and 13 neurons whose D2 is undefined. If the excluded neurons shaped the map, changing the threshold would change which neurons appear history-driven or population-driven. With thresholds of 0, 0.02 and 0.10, however, the agreement between SCRYER and POCO stays between 0.46 and 0.53, and SCRYER's median Δ changes close to zero by less than 0.04, so the balance between the two groups is also unchanged.
| Spearman of Δ | SCRYER, two masks | POCO, two masks | SCRYER vs POCO, mean mask | SCRYER vs POCO, in-dist. mask |
|---|---|---|---|---|
| Neurons | 0.85 | 0.90 | 0.51 | 0.44 |
| Regions | 0.90 | 0.92 | 0.66 | 0.80 |
Response to Reviewer Dnjg
We thank the reviewer for the detailed and constructive review. We have conducted additional experiments to address your feedback, including:
1. Validation of the key contributions (W1, Q1–Q2)
While SCRYER builds on established components, including the neuron-level embeddings of POYO, its main architectural innovation is the coupling of neuron-level retrieval with forecast selection. Each target neuron attends to individual co-recorded neurons and uses the retrieved information to select among candidate forecasts derived from its own multiscale history. POCO and OmniMouse instead compress population activity into shared latents, which prevents direct neuron-to-neuron querying. NetFormer also attends between neurons, but mixes their activity directly into the forecast and is trained separately for each recording. SCRYER thus enables population-informed forecast selection and direct analysis of neuron-to-neuron attention within a single model shared across animals.
Contribution of forecast candidate generation and selection (Q1)
We thank the reviewer for these suggestions. We ran the four suggested ablations (correction only, single MLP, uniform selection, energy weights only) on the 29 held-out sessions of the IBL Brain-wide benchmark. The full model performs best (D² 0.166) and every ablation lowers it. The largest drop was for the correction-only ablation (0.150), followed by the single MLP (0.159) and uniform weights (0.159), and then the energy weights only (0.161). The gain therefore comes from generating candidate forecasts and selecting among them with population-conditioned weights.
Contribution and interpretation of neuron-level retrieval (Q2)
We thank the reviewer for their suggestions. We performed all suggested analyses on the 29 held-out IBL recordings. Most neurons attend to a large fraction of the population but sharpen their focus on a small subset, and that subset changes over the recording.
Self-attention weights and attention entropy across neurons. We found that the distribution of attention in most recordings is heavy tailed. The four most-attended neurons receive 18% of a target's attention, 4.5 times its attention to the remaining neurons. The median normalized entropy is 0.89 and 0.91 for the two layers (1 for uniform attention), so most targets attend broadly yet concentrate on a few sources. Results in this direction would allow choosing most appropriate graph types for the models of brain neural networks (previously the contributions here were largely theoretical) and building heterogeneous models of neural activity that use subgraphs representing different cell types.
Whether different target neurons attend to different source neurons. To show that each target has its own attention pattern, we measured the effective rank of each recording's attention matrix after removing uniform attention. If all targets attended to the same neurons the rank would be 1. Instead, the effective rank is 28 and 33 for the two attention layers in a typical recording of 102 neurons. Part of the attention is still shared, since one component common to all targets explains 66–79% of the matrix, reflecting sources that every target favours, such as fast-firing neurons. The remaining 21–34% differs between targets, and most of it lies in four further components, so the target-specific part is structured rather than noise.
The relationship between attention weights and neuronal activity correlations. To show that attention maps of fixed target neurons change over time, we compared its four most-attended sources between two one-second windows drawn at random from the test period. Their Jaccard index (sources in both sets divided by sources in either set, 1 for identical sets and about 0.02 for random sets) is 0.16, so one source is kept and three change with the ongoing activity. To test whether attention merely tracks correlation, we removed at test time either a target's four most-attended sources or its four most-correlated sources. The drop in D² was 0.047 (95% CI 0.027–0.072) for the attended sources, 0.011 for the correlated sources and 0.003 for random sources. The gap remains at a matched firing rate (0.035 vs 0.013 on the 281 targets where both sets fire at the same rate). Retrieval therefore selects sources that matter for the forecast beyond what correlation or firing rate explain.