Risk-Aware Gradient Allocation for Spiking Neural Network
Abstract
Surrogate-gradient learning enables the direct training of spiking neural networks (SNNs), but conventional threshold-centered surrogates concentrate backward gradient energy on the membrane states most susceptible to spike flipping. We recast surrogate design as a risk-aware gradient allocation problem and introduce Gradient Risk Exposure (GRE) to quantify this mismatch between gradient concentration and state instability. By minimizing GRE subject to a Kullback–Leibler penalty on deviations from the baseline allocation, we derive the Risk-Calibrated Surrogate Gradient (RCSG), a closed-form exponential calibration applicable to arbitrary baseline surrogates. RCSG redistributes gradient energy toward more stable membrane states without altering the forward neuronal dynamics or requiring an auxiliary robustness loss. On three static-image classification benchmarks, RCSG improves adversarial robustness while maintaining or improving clean accuracy, and its gains hold consistently across surrogate families, network architectures, and attack gradient estimators.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.