- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
SpikeLite combines two components for spiking time-series forecasting. The Frequency-Selective Spiking Encoder (FSSE) applies parallel LIF branches with different learnable decay factors to each variable. Differences between adjacent branch responses and a final residual sum back to the original input before projection, giving a frequency-sensitive decomposition. Sparse Spiking Channel Attention (SSCA) then derives a sample-dependent binary channel mask from FFT descriptors of the learned representations and applies it to spike-driven attention; the mask is trained with a straight-through estimator. The method can omit SSCA for a lighter channel-independent path.
The evaluation follows the SeqSNN protocol on four standard multivariate benchmarks and the SpikF protocol on eight long-term benchmarks. The reported aggregate results are and RSE for the former, and MSE and MAE for the latter. On ECL at horizon 720, the estimated encoder energy is 95.30 µJ per sample, compared with 117.66 µJ for SpikF, using a 45-nm operation-cost model. The paper includes three-seed stability measurements, ablations on Traffic and Weather, a frequency sweep, and a detailed operation-count appendix.
Critical strengths
FSSE has a clear signal-processing motivation. Linearized LIF dynamics are low-pass filters whose response changes with the decay factor, and the successive differences plus residual form an exact reconstruction before the learned projection. The paper verifies distinct responses with a sinusoidal sweep. The nonlinear spike threshold means these are not clean frequency bands, but the proposed representation is still more principled than adding an arbitrary stack of spiking layers.
The results cover two established forecasting protocols and include ANN models as well as SNN baselines. The ablation is informative on Traffic: removing FSSE raises average MSE from 0.479 to 0.489, while removing SSCA raises it to 0.602; Weather shows the same direction, with smaller differences. The three-seed tables show small within-method variance. On ECL the model also slightly improves MSE@720 over SpikF, 0.218 versus 0.219, while reducing estimated encoder energy by about 19%. Taken together, these are credible reasons to consider the method, particularly where cross-channel structure matters.
Critical weaknesses
-
The average MSE advantage is thin: 0.343 versus 0.345 for iTransformer and 0.346 for SpikF, while Weather is tied with SpikF at 0.245. The method also loses to some alternatives on individual ETT and Exchange settings, including a weak Exchange 720 result discussed in the appendix. Since most competitor numbers are imported from earlier papers and only the new method has a three-seed stability table here, the paper does not establish that the 0.002–0.003 aggregate gap is robust to matched tuning and implementation. The large SSCA ablation on Traffic demonstrates that channel interaction helps there, but it does not show whether this particular sparse mechanism is better than a comparably sized dense or simpler channel mixer.
-
The efficiency result is a modeled estimate on one dataset/horizon, not a measured energy or latency result. Appendix F does count the FFT and mask-generation operations and uses measured spike rates, so the accounting is more careful than a simple MAC count. Still, it excludes the prediction head for all methods and cannot capture memory traffic, sparse-kernel overhead or the cost of materializing and applying the mask on actual hardware. The ECL comparison also shows 67.2K parameters for SpikeLite against 1.2K for SpikF; the proposed model is lower in estimated energy, but it is not smaller by every reasonable definition of “lightweight.” The current evidence supports a lower estimated encoder operation cost under the stated assumptions; it does not yet establish a lower deployment cost.
Questions for authors
Could the authors compare FSSE plus SSCA against FSSE plus dense SSA and against a simple, parameter-matched channel mixer under the same training budget? Per-dataset mask density, actual skipped operations and latency would help determine whether sparsity, rather than merely channel mixing, drives the claimed efficiency gain. This is especially relevant given the large Traffic ablation gap.
For the close long-term forecasting margins, can the authors rerun the strongest imported baselines under one code and tuning protocol, or report paired uncertainty from matched runs? Could they also provide end-to-end latency or measured energy on a concrete target, including the prediction head? I would weigh the paper more favorably if the small accuracy improvement and the estimated energy saving held under those comparisons.
2 comments
Q2. Details of Our Results
First we tested SpikF, the strongest baseline, and its results are consistent with those reported in the table. In addition, we supplemented the evaluation with results for SpikHRFSSM, as shown below.
SpikeLite obtains average MSE/MAE of 0.3434/0.3446, compared with 0.3458/0.3456 for SpikF, and 0.3492/0.3470 for SpikHRFSSM. The results show that SpikF remains the best-performing method, this improvement is both stable and clear.
| Method | ECL MSE | ECL MAE | Weather MSE | Weather MAE | ETTh1 MSE | ETTh1 MAE | ETTh2 MSE | ETTh2 MAE | ETTm1 MSE | ETTm1 MAE | ETTm2 MSE | ETTm2 MAE | Traffic MSE | Traffic MAE | Exchange MSE | Exchange MAE | Avg. MSE | Avg. MAE |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SpikF | 0.183 | 0.275 | 0.245 | 0.265 | 0.440⁎ | 0.428⁎ | 0.372 | 0.394 | 0.388 | 0.385⁎ | 0.281 | 0.320 | 0.497 | 0.296 | 0.360⁎ | 0.402† | 0.3458 | 0.3456† |
| SpikeLite | 0.175⁎ | 0.263⁎ | 0.245 | 0.265† | 0.443† | 0.429† | 0.374 | 0.394† | 0.387† | 0.389† | 0.278 | 0.319† | 0.479⁎ | 0.294† | 0.366† | 0.404 | 0.3434⁎ | 0.3446⁎ |
| SpikHRFSSM | 0.195 | 0.275 | 0.242† | 0.264⁎ | 0.443† | 0.431 | 0.368† | 0.393⁎ | 0.390 | 0.389† | 0.274⁎ | 0.316⁎ | 0.494 | 0.291⁎ | 0.388 | 0.417 | 0.3493 | 0.3470 |
Then we report our energy consumption on ECL-720 and Weather-720. Compared with SpikF, currently the most energy-efficient module, we achieve better energy efficiency both with and without the prediction head. The advantage is especially pronounced in the prediction head: SpikeLite uses a single-layer linear readout, whereas SpikF uses an MLP decoder applied across temporal groups, so according to the code-shape computation, the prediction head of SpikF incurs a higher cost.
All values are in µJ per sample under the 45-nm operation-cost model (MAC = 4.6 pJ; AC = 0.9 pJ).
| Dataset / method | Encoder estimate | Prediction head / decoder | Total |
|---|---|---|---|
| ECL@720 SpikeLite | 95.30 | 136.08 | 231.38 |
| ECL@720 SpikF | 117.66 | 1,259.87 | 1,377.35 |
| Weather@720 SpikeLite | 23.55 | 25.04 | 48.59 |
| Weather@720 SpikF | 112.57 | 1,255.27 | 1,367.84 |
Table 2. Weather@720 component breakdown
| Method | Component | Operation type / assumption | Energy |
|---|---|---|---|
| SpikeLite | FSSE LIF branch updates | AC, r=0.1634 | 0.0027 |
| SpikeLite | Four frequency-band projections | MAC | 13.3540 |
| SpikeLite | Identity projection | MAC | 3.3385 |
| SpikeLite | SSCA input LIF | AC, r=0.1634 | 0.0089 |
| SpikeLite | SSCA Q/K/V projections | AC, r=0.1634 | 4.8029 |
| SpikeLite | SSCA QKᵀ and AV | Dense-attention upper bound | 0.1868 |
| SpikeLite | SSCA output projection | AC, r=0.1634 | 1.6010 |
| SpikeLite | Mask generation | MAC, once per input window | 0.4352 |
Table 3. Traffic @720 component breakdown
| FSSE component | Operation count | Accounting | Energy (µJ/sample) |
|---|---|---|---|
| LIF branch updates | 0.324 M | AC, r=0.1503 | 0.0438 |
| Three frequency-band projections | 20.708 M | Dense MAC | 95.2584 |
| FSSE encoder total | 95.3022 |
We sincerely thank the reviewer for the constructive and detailed evaluation. We provide a point-by-point response to each of your valuable comments to ensure clarity and address all aspects thoroughly.
Q1. Effectiveness of SSCA
The central distinction is the role of the channel mask. SSCA uses a binary mask to gate pairwise scores in no-softmax attention over binary, spike-generated Q/K/V. DUET uses channel relationships to select interactions in its normalized continuous-attention formulation. SSCA shares the use of rFFT descriptors, learnable distances, reciprocal affinities, and row-wise normalization with DUET. We use rFFT because the FSSE representation retains frequency-selective structure. Our design then forms a low-rank relation metric and applies deterministic thresholding for spike-driven channel routing.
We evaluate three DUET-style mask variants within the same SpikeLite forecasting setup. The raw-versus-latent comparison tests descriptor source, and the latent stochastic-versus-threshold comparison tests discretization. The detailed MSE/MAE table and operation-model energy estimates are provided in our responses to Reviewer FzWT’s Q1 and Q2. In summary, SSCA is competitive with dense SSA, outperforms the same-density random-mask control in 11 of 12 settings, and the global mixer has higher forecasting errors across the reported settings. On Traffic, the mask-aware operation estimate is 321.85 μJ/sample for SSCA versus 429.12 μJ/sample for dense SSA.