Membrane Sensitivity and Deployment Fragility of Learnable Time Constants in Spiking Neural Networks
Abstract
Spiking neural networks (SNNs) with learnable membrane time constants can improve temporal processing by adapting neuronal integration timescales, but they also turn the decay factor into an optimized dynamical parameter that is fragile under hardware-induced parameter mismatch. We develop a perturbation-based account of how time-constant variation affects trained SNNs. In controlled software simulations, this fragility is strongly task-dependent: Spiking Heidelberg Digits (SHD) and Spiking Speech Commands (SSC) settings lose percentage points of accuracy under % coefficient-of-variation (CV) perturbations in , whereas DVS-Gesture and CIFAR-10 lose less than pp. We show that, under a surrogate-linearized first-order analysis, the failure mode is governed by the membrane sensitivity . This quantity admits a closed-form online recursion requiring only one additional state per layer and no extra temporal storage. The analysis identifies time-averaged sensitivity energy as the controllable term in deployment fragility, leading to (embrane-ware obustness through Regularization), a training objective derived from perturbation analysis rather than heuristic noise augmentation. We prove a conservative worst-case output-perturbation bound and introduce a typical-case diagnostic explaining why sensitivity remains predictive when worst-case constants are vacuous. At % CV perturbation, MARS reduces the accuracy drop in the sensitive settings to at most pp while preserving nominal accuracy, with minimal effect on DVS-Gesture and CIFAR-10.
Related papers
See more related submissions when the market opens.